-- Logs begin at Sun 2022-10-02 00:10:32 UTC, end at Sun 2022-10-02 01:37:04 UTC. -- Oct 02 00:46:11.485929 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 02 00:46:11.496365 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 2 00:46:11 2022] *** Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: nodename: dv-cinder-master-3-iscsi Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: machine: x86_64 Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: clock source: unix Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: pcre jit disabled Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: detected number of CPU cores: 4 Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: current working directory: / Oct 02 00:46:11.498622 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: detected binary path: /usr/bin/uwsgi-core Oct 02 00:46:11.499353 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: your processes number limit is 47680 Oct 02 00:46:11.499353 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: your memory page size is 4096 bytes Oct 02 00:46:11.499353 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: detected max file descriptor number: 2048 Oct 02 00:46:11.499353 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: lock engine: pthread robust mutexes Oct 02 00:46:11.499353 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: thunder lock: enabled Oct 02 00:46:11.499353 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 02 00:46:11.499353 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 02 00:46:11.537954 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: Python main interpreter initialized at 0x560c4893e9c0 Oct 02 00:46:11.537954 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: python threads support enabled Oct 02 00:46:11.537954 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: your server socket listen backlog is limited to 100 connections Oct 02 00:46:11.537954 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: your mercy for graceful operations on workers is 90 seconds Oct 02 00:46:11.538354 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: mapped 403077 bytes (393 KB) for 2 cores Oct 02 00:46:11.538430 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: *** Operational MODE: preforking *** Oct 02 00:46:11.539245 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: *** uWSGI is running in multiple interpreter mode *** Oct 02 00:46:11.539245 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: spawned uWSGI master process (pid: 105446) Oct 02 00:46:11.539450 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 02 00:46:11.540855 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: spawned uWSGI worker 1 (pid: 105447, cores: 1) Oct 02 00:46:11.540855 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: spawned uWSGI worker 2 (pid: 105448, cores: 1) Oct 02 00:46:11.540855 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 02 00:46:12.196398 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:46:12.198780 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:46:13.271007 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:46:13.271007 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: from cryptography.utils import int_from_bytes Oct 02 00:46:13.271691 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:46:13.271691 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: from cryptography.utils import int_from_bytes Oct 02 00:46:13.273947 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:46:13.273947 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: from cryptography.utils import int_from_bytes Oct 02 00:46:13.274389 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:46:13.274389 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: from cryptography.utils import int_from_bytes Oct 02 00:46:15.742047 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:46:15.742698 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:46:15.742793 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:46:15.743144 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:46:15.743242 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:46:15.743329 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:46:15.743410 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:46:15.743532 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:46:15.743778 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.743881 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:46:15.744098 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.744210 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:46:15.744413 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.744520 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.744724 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.744834 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.745043 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.745145 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.745346 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.745443 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.745659 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.745757 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.745970 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.746086 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.746314 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.746399 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.746569 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.746670 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.746876 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.746968 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.747191 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.747277 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.747500 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.747584 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.747798 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.747889 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.748104 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.748213 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.748413 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.748515 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.748707 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.748792 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.749021 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.749186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.749319 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.749402 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.749637 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.749811 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.749941 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.750275 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.750461 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.750851 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.751044 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.751146 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.751348 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.751443 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.751670 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.751791 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.751984 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.752070 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.752298 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.752395 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.752603 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.752711 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.752919 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.753022 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.753224 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.753328 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.753545 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.753652 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.753851 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.754020 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.754236 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.754384 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.754547 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.754640 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.754900 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.754991 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.755211 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.755311 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.755535 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.755623 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.755849 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.755945 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.756167 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.756252 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.756470 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.756562 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.756791 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.756889 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.757156 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.757843 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.758016 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.758122 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.758359 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.758462 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.758675 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.758772 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.758980 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.759065 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.759277 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.759375 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.759585 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.759683 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.759883 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.759968 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.760184 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.760285 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.760428 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.760520 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.760729 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.760823 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.761009 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.761093 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.761314 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.761404 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.761630 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.761774 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.761883 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.761968 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.762152 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.762275 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.762466 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.762554 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.762762 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.762855 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.763069 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.763161 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.763373 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.763467 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.763677 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.763767 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.763977 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.764075 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.764278 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.764367 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.764575 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.764658 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.764875 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.764966 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.765174 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.765257 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.765474 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.765567 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.765776 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.765870 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.766106 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.766194 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.766413 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.766497 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.766727 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.766871 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.767033 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.767128 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.767344 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.767442 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.767647 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.767740 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.767966 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.768056 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.768271 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.768356 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.768569 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.768678 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.768881 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.768968 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.769193 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.769289 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.769495 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.769588 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.769792 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.769877 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.770121 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.770212 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.770415 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.770501 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.770719 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.770804 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.771028 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.771112 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.771274 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.771374 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.771571 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.771693 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.771871 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.771965 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.772167 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.772251 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.772469 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.772557 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.772810 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.772905 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.773112 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.773195 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.773408 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.773493 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.773709 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.773804 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.774007 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.774150 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.774336 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.774432 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.774636 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.774729 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.774936 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.775030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.775235 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.775318 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.775533 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.775633 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.775834 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.775926 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.776133 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.776218 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.776428 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.776513 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.776727 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.776817 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.777028 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.777112 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.777326 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.777419 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.777626 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.777720 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.777926 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.778010 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.778248 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.778337 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.778554 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.778641 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.778851 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.778946 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.779153 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.779247 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.779453 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.779537 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.779752 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.779841 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.780048 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.780139 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.780358 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.780441 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.780657 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.780756 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.780959 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.781046 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.781271 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.781387 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.781563 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.781659 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.781862 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.781977 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.782185 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.782279 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.782487 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.782585 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.782791 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.782940 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.783083 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.783230 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.783384 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.783527 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.783662 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.783804 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.783941 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.784075 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.784226 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.784375 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.784519 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.784654 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.784799 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.784936 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.785070 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.785231 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.785366 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.785500 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.785665 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.785801 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.785964 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.786153 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.786303 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.786388 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.786608 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.786701 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.786911 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.786998 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.787226 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:46:15.787337 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.787558 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.787647 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.787868 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.787960 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.788194 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.788287 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.788538 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.788623 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.788851 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.788979 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.789160 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.789254 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.789469 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.789569 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.789783 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.789866 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.790104 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.790203 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.790413 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.790507 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.790720 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.790805 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.791028 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.791111 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.791338 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.791446 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.791651 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.791744 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.791959 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.792097 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.792272 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.792372 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.792584 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.792668 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.792887 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.792971 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.793199 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.793298 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.793509 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.793594 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.793825 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.793909 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.794150 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.794255 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.794480 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.794573 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.794792 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.794878 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.795111 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.795205 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.795432 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.795518 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.795748 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.795833 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.796056 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.796145 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.796362 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.796448 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.796668 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.796753 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.796974 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.797060 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.797283 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.797369 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.797590 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.797681 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.797906 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.797992 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.798242 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.798329 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.798561 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.798660 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.798869 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.798954 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.799174 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.799260 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.799480 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.799580 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.799785 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.799870 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.800088 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.800173 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.800396 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.800489 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.800710 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.800796 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.801022 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.801106 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.801334 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.801427 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.801640 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.801726 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.801954 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.802129 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.802287 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.802382 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.802593 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.802680 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.802899 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.803035 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.803200 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.803287 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.803498 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.803583 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.803799 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.803883 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.804632 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.804769 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.804931 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.805016 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.805239 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.805324 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.805543 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.805630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.805845 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.805930 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.806196 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.806286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.806501 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.806601 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.806805 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.806889 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.807110 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.807205 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.807415 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.807510 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.807712 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.807796 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.808018 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.808174 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.808322 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.808407 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.808622 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.808708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.808927 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.809024 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.809232 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.809328 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.809529 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.809620 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.809843 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.809936 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.810164 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.810253 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.810468 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.810556 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.810780 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.810867 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.811084 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.811169 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.811386 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.811469 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.811692 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.811785 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.811996 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.812079 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.812304 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.812389 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.812608 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.812694 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.812915 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.813000 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.813223 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.813320 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.813532 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.813618 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.813850 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.813941 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.814193 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.814301 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.814500 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.814592 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.814812 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.814895 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.815111 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.815206 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.815415 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.815501 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.815714 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.815799 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.816014 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.816109 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.816311 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.816397 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.816611 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.816694 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.816906 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.816999 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.817204 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.817298 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.817502 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.817587 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.817800 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.817885 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.818121 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.818221 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.818441 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.818525 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.818744 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.818830 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.819040 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.819125 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.819339 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.819435 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.820185 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.820286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.820509 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.820601 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.820817 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.820903 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.821150 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.821243 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.821452 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.821544 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.821776 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.821873 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.822111 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.822209 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.822423 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.822520 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.822733 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.822829 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.823038 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.823130 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.823342 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.823427 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.823649 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.823748 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.823954 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.824039 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.824262 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.824345 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.824566 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.824659 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.824881 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.824964 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.825184 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.825268 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.825500 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.825588 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.825805 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.825890 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.826141 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.826229 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.826446 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.826534 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.826757 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.826843 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.827058 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.827143 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.827373 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.827469 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.827705 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.827790 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.828020 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.828105 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.828329 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.828416 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.828639 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.828725 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.828946 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.829031 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.829251 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.829379 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.829558 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.829644 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.829860 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.829953 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.830193 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.830282 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.830501 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.830585 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.830816 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.830923 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.831124 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.831209 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.831440 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.831524 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.831746 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.831840 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.832060 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.832145 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.832361 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.832461 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.832675 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.832781 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.832974 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.833066 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.833285 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.833377 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.833606 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.833700 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.833913 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.833998 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.834253 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.834340 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.834558 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.834645 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.834864 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.834950 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.835186 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.835281 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.835495 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.835588 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.835799 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.835894 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.836101 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.836193 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.836406 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.836493 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.836708 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.836793 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.837014 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.837110 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.837315 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.837400 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.837620 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.837703 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.837923 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.838022 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.838245 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.838333 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.838547 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.838640 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.838849 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.838942 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.839154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.839249 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.839463 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.839547 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.839782 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.839882 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.840095 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.840180 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.840393 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.840477 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.840693 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.840786 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.841005 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.841143 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.841311 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.841399 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.841611 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.841698 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.841911 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.841996 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.842236 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.842325 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.842542 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.842631 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.842848 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.842937 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.843152 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.843245 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.843465 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.843552 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.843781 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.843906 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.844081 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.844178 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.844391 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.844488 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.844697 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.844782 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.844997 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.845111 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.845309 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.845402 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.845615 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.845708 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.845917 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.846010 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.846258 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.846345 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.846565 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.846650 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.846870 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.846962 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.847176 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.847269 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.847485 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.847570 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.847789 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.847883 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.848096 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.848180 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.848404 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.848557 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.848697 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.848833 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.848993 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.849130 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.849297 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.849448 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.849610 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.849858 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.849954 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.850216 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.850492 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.850586 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.850849 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.850936 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.851167 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.851252 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.851484 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.851585 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.851825 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.852000 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.852144 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.852231 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.852466 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.852551 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.852771 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.852860 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.853065 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.853163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.853367 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.853459 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.853671 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.853756 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.853974 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.854074 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.854300 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.854387 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.854605 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.854690 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.854905 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.854990 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.855209 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.855294 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.855508 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.855602 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.855808 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.855894 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.856107 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.856190 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.856406 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.856503 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.856709 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.856794 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.857008 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.857093 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.857315 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.857411 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.857613 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.857696 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.857923 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.858007 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.858249 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.858351 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.858548 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.858641 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.858850 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.858936 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.859148 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.859233 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.859450 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.859535 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.859752 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.859849 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.860085 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.860179 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.860385 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.860469 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.860721 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.860807 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.861019 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.861115 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.861322 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.861408 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.861640 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.861733 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.861941 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.862025 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.862266 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.862365 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.862566 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.862661 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.862867 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.862953 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.863168 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.863261 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.863462 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.863563 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.863765 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.863850 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.864064 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.864151 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.864366 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.864459 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.864669 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.864757 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.864968 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.865059 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.865271 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.865364 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.865565 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.865657 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.865867 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.865951 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.866191 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.866282 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.867016 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.867106 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.867319 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.867403 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.867617 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.867705 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.867917 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.868002 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.868214 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.868305 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.868516 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.868602 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.868812 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.868904 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.869117 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.869209 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.869414 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.869507 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.869713 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.869857 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.870011 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.870161 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.870334 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.870426 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.870635 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.870728 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.870932 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.871025 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.871240 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.871323 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.871541 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.871626 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.871839 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.871932 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.872143 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.872258 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.872444 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.872540 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.872739 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.872851 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.873036 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.873123 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.873335 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.873425 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.873637 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.873726 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.873942 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.874027 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.874264 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.874361 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.874570 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.874658 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.874868 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.874953 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.875169 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.875255 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.875467 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.875803 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.876022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.876167 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.876318 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.876416 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.876617 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.876703 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.876914 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.877005 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.877212 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.877305 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.877508 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.877593 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.877807 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.877890 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.878130 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.878300 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.878433 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.878532 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.878735 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.878864 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.879034 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.879130 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.879338 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.879425 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.879642 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.879727 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.879985 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.880073 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.880284 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.880368 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.880596 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.880682 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.880912 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.880999 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.881218 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.881303 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.881525 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.881614 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.881831 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.881916 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.882702 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.882796 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.883030 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.883135 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.883332 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.883420 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.883646 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.883738 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.883945 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.884030 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.884247 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.884334 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.884547 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.884631 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.884850 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.884944 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.885155 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.885239 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.885466 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.885595 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.885775 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.885868 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.886109 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.886199 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.886413 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.886510 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.886719 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.886822 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.887026 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.887113 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.887330 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.887424 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.887635 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.887731 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.887939 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.888023 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.888244 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.888334 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.888552 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.888637 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.888855 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.888939 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.889162 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.889246 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.889467 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.889552 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.889765 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.889851 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.890099 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.890196 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.890394 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.890481 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.890689 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.890773 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.891003 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.891086 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.891305 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.891390 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.891605 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.891697 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.891910 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.892005 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.892209 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.892294 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.892513 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.892596 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.892810 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.892902 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.893116 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.893230 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.893417 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.893538 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.893836 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.893935 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.894162 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.894261 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.894471 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.894559 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.894772 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.894864 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.895080 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.895171 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.895389 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.895473 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.895687 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.895772 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.896001 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.896084 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.896303 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.896388 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.896683 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.896775 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.896988 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.897080 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.897286 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.897372 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.897584 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.897672 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.897921 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.898005 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.898248 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.898373 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.898586 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.898673 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.898887 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.898974 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.899187 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.899284 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.899486 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.899578 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.899788 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.899881 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.900106 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.900232 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.900406 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.900506 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.900728 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.900834 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.901097 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.901206 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.901435 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.901530 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.901738 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.901840 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.902104 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.902218 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.902425 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.902535 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.902743 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.902832 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.903069 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.903216 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.903370 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.903527 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.903685 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.903835 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.903990 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.904131 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.904305 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.904451 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.904613 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.904749 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.904918 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.905054 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.905230 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.905363 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.905532 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.905664 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.905844 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.905939 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.906175 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.906276 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.906485 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.906577 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.906804 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.906889 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.907118 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.907255 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.907436 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.907523 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.907803 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.907900 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.908119 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.908215 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.908436 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.908522 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.908736 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.908829 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.909035 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.909122 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.909339 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.909432 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.909639 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.909733 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.909938 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.910029 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.910265 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.910361 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.910564 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.910659 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.910871 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.910958 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.911177 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.911260 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.911479 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.911571 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.911781 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.911874 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.912081 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.912166 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.912380 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.912465 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.912682 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.912774 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.912998 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.913090 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.913317 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.913405 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.913642 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.913731 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.913956 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.914051 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.914282 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.914369 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.914599 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.914685 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.914900 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.914994 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.915198 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.915283 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.915500 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.915585 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.915799 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.915899 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.916099 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.916190 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.916401 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.916494 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.916725 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.916822 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.917035 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.917120 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.917355 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.917439 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.917658 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.917789 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.917986 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.918108 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.918316 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.918400 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.918637 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.918731 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.918943 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.919029 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.919254 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.919341 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.919565 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.919650 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.919862 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.919959 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.920162 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.920249 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.920468 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.920558 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.920767 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.920854 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.921068 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.921154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.921366 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.921453 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.921668 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.921751 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.921964 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.922079 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.922289 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.922388 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.922589 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.922680 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.922890 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.922990 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.923192 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.923314 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.923505 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.923589 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.923809 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.923906 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.924107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.924191 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.924408 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.924494 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.924707 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.924872 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.925008 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.925092 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.925310 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.925396 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.925641 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.925727 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.925946 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.926038 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.926289 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.926376 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.926599 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.926686 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.926912 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.926995 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.927226 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.927309 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.927537 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.927631 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.927850 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.927942 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.928162 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.928254 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.928475 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.928561 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.928778 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.928862 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.929617 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.929712 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.929926 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.930010 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.930264 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.930351 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.930583 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.930780 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.930899 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.931111 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.931423 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.931508 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.931735 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.931828 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.932047 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.932133 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.932355 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.932439 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.932665 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.933010 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.933086 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.933158 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.933269 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.933358 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.933576 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.933670 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.933879 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.933963 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.934213 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.934312 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.934523 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.934618 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.934843 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.934928 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.935160 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.935243 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.935475 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.935560 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.935786 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.935871 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.936099 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.936193 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.936410 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.936494 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.936722 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.936813 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.937036 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.937135 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.937344 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.937437 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.937658 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.937752 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.937970 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.938072 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.938303 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.938387 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.938610 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.938704 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.938918 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.939005 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.939226 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.939309 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.939533 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.939625 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.939842 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.939928 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.940148 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.940233 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.940456 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.940548 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.940762 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.940855 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.941087 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.941180 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.941389 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.941485 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.941702 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.941787 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.942010 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.942150 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.942347 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.942444 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.942657 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.942742 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.942971 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.943165 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.943285 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.943475 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.943801 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.943888 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.944115 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.944210 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.944430 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.944515 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.944829 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.944928 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.945144 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.945238 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.945464 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.945551 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.945766 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.945858 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.946081 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.946230 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.946396 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.946483 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.946700 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.946785 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.947001 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.947097 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.947308 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.947393 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.947610 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.947694 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.947911 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.948010 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.948223 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.948307 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.948525 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.948609 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.948839 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.949050 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.949137 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.949389 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.949666 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.949756 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.950008 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.950123 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.950347 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.950431 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.950665 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.950750 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.950971 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.951065 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.951289 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.951375 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.951594 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.951680 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.951897 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.951992 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.952207 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.952291 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.952511 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.952594 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.952812 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.952899 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.953112 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.953213 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.953411 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.953505 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.953713 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.953800 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.954011 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.954155 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.954344 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.954438 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.954643 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.954727 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.954947 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.955037 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.955249 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.955343 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.955547 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.955632 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.955849 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.955942 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.956155 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.956246 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.956454 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.956541 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.956754 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.956846 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.957054 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.957140 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.957349 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.957433 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.957650 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.957741 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.957949 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.958034 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.958278 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.958367 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.958579 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.958674 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.958886 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.958972 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.959186 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.959269 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.959496 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.959581 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.959810 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.959895 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.960128 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.960718 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.960955 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.961059 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.961256 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.961342 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.961570 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.961662 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.961871 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.962035 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.962212 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.962299 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.962520 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.962604 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.962826 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.962929 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.963136 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.963229 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.963446 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.963532 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.963790 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.963980 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.964104 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.964317 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.964633 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.964718 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.964963 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.965062 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.965282 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.965367 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.965582 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.965676 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.965885 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.965972 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.966210 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.966299 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.966534 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.966629 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.966838 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.966924 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.967143 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.967241 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.967449 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.967544 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.967756 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.967844 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.968063 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.968148 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.968369 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.968462 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.968673 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.968757 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.968979 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.969076 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.969282 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.969375 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.969588 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.969672 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.969891 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.969976 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.970219 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.970322 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.970525 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.970611 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.970828 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.970959 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.971136 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.971230 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.971445 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.971531 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.971761 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.971852 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.972071 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.972163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.972382 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.972473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.972695 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.972781 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.973000 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.973088 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.973306 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.973393 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.973610 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.973703 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.973917 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.974011 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.974244 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.974331 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.974555 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.974650 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.974872 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.974958 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.975172 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.975256 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.975496 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.975828 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.976449 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.976705 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.976999 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.977086 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.977317 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.977404 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.977623 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.977709 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.977941 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.978033 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.978276 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.978371 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.978599 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.978685 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.978924 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.979043 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.979235 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.979335 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.979552 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.979647 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.979861 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.979974 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.980189 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.980285 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.980504 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.980599 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.980805 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.980930 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.981108 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.981204 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.981408 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.981518 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.981714 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.981810 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.982026 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.982141 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.982356 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.982441 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.982655 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.982743 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.982953 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.983045 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.983254 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.983339 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.983550 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.983636 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.983850 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.983982 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.984150 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.984235 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.984451 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.984537 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.984750 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.984833 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.985045 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.985135 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.985344 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.985431 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.985642 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.985733 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.985937 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.986030 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.986259 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.986346 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.986561 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.986655 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.986862 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.987019 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.987157 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.987293 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.987430 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.987564 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.987732 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.987831 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.988032 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.988117 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.988328 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.988420 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.988626 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.988724 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.988929 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.989015 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.989258 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.989345 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.989572 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.989659 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.989877 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.989963 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.990216 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.990318 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.990523 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.990609 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.990837 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.990922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.991149 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.991236 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.991481 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.992110 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.992285 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.992373 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.992612 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.992698 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.992920 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.993006 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.993223 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.993308 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.993529 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.993624 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.993834 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.993928 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.994165 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.994254 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.994470 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.994569 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.994775 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.994860 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.995082 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.995167 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.995384 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.995479 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.995703 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.995791 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.996007 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.996091 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.996324 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.996409 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.996635 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.996720 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.996940 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.997028 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.997251 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.997337 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.997555 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.997639 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.997859 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.997944 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.998186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.998281 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.998492 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.998588 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.998798 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.998893 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.999104 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.999189 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.999409 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.999501 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.999712 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:15.999805 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.000019 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.000104 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.000325 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.000410 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.000888 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.000988 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.001206 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.001293 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.001509 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.001601 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.001830 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.001917 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.002157 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.002244 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.002484 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.002570 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.002801 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.002897 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.003140 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.003226 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.003447 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.003533 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.003756 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.003842 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.004063 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.004191 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.004369 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.004456 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.004606 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105448) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:46:16.004693 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.004978 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:46:16.005216 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:46:16.158665 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO dbcounter [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Registered counter for database nova_api Oct 02 00:46:16.158900 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO dbcounter [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Registered counter for database nova_api Oct 02 00:46:16.178543 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_db.sqlalchemy.engines [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:46:16.180382 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_db.sqlalchemy.engines [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:46:16.185159 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writer thread running {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:46:16.187102 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writer thread running {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:46:16.241038 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.context [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3c3637e-55d8-46cc-8af5-7f3f543268bb(cell1) {{(pid=105447) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:46:16.243777 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.context [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3c3637e-55d8-46cc-8af5-7f3f543268bb(cell1) {{(pid=105448) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:46:16.244931 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:46:16.245394 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:46:16.247005 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:46:16.247600 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:46:16.247728 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:46:16.248072 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:46:16.248171 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:46:16.249655 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:46:16.250135 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:46:16.250413 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:46:16.251116 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:46:16.252370 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO dbcounter [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Registered counter for database nova_cell0 Oct 02 00:46:16.253107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_concurrency.lockutils [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105448) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:46:16.255168 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO dbcounter [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Registered counter for database nova_cell0 Oct 02 00:46:16.256384 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO dbcounter [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Registered counter for database nova_cell1 Oct 02 00:46:16.259683 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO dbcounter [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Registered counter for database nova_cell1 Oct 02 00:46:16.264145 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_db.sqlalchemy.engines [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:46:16.265336 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_db.sqlalchemy.engines [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:46:16.267852 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_db.sqlalchemy.engines [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:46:16.270012 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_db.sqlalchemy.engines [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:46:16.271670 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writer thread running {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:46:16.275774 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writer thread running {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:46:16.277573 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writer thread running {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:46:16.278709 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writer thread running {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:46:16.417036 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO dbcounter [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Registered counter for database nova_cell0 Oct 02 00:46:16.423243 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO dbcounter [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Registered counter for database nova_cell0 Oct 02 00:46:16.425638 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_db.sqlalchemy.engines [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:46:16.430944 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writer thread running {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:46:16.432388 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG oslo_db.sqlalchemy.engines [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105448) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:46:16.437039 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writer thread running {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:46:16.771347 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: WARNING keystonemiddleware.auth_token [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:46:16.773877 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: WARNING keystonemiddleware.auth_token [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:46:16.779266 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: WARNING keystonemiddleware.auth_token [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:46:16.781204 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: WARNING keystonemiddleware.auth_token [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:46:17.122921 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: WARNING keystonemiddleware.auth_token [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:46:17.128711 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: WARNING keystonemiddleware.auth_token [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:46:17.129123 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: WARNING keystonemiddleware.auth_token [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:46:17.134468 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c4893e9c0 pid: 105447 (default app) Oct 02 00:46:17.134723 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: WARNING keystonemiddleware.auth_token [None req-1ac9e806-a9e5-4320-9ad5-304992bf8def None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:46:17.136506 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:46:17.137681 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001705 Oct 02 00:46:17.138102 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Sun Oct 2 00:46:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:46:17.140008 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c4893e9c0 pid: 105448 (default app) Oct 02 00:47:38.053089 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:38.054812 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002136 Oct 02 00:47:38.060530 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:47:38.072482 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:SELECT=3 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:38.074274 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_cell1:SELECT=3 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:38.075587 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_cell0:SELECT=3 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:38.076693 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:38.922343 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-5eebad5f-9d58-481c-80ed-b51c2494202d admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:38.955185 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-5eebad5f-9d58-481c-80ed-b51c2494202d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.892593 Oct 02 00:47:38.956292 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Oct 2 00:47:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:47:41.588258 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:41.589262 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-df0d4fc7-54b5-4846-8138-ec1e504e0c10 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 02 00:47:41.589822 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:47:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:47:42.058775 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-595d8446-ed7a-47a2-b62f-be68f7e2d27d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "disk": 1, "swap": 0, "name": "cirros256", "vcpus": 1}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:42.106971 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-595d8446-ed7a-47a2-b62f-be68f7e2d27d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511198 Oct 02 00:47:42.107834 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:47:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:42.121530 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_api:SELECT=3 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:42.122393 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_cell0:SELECT=3 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:42.124727 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_cell1:SELECT=3 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:42.125784 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:47:42.330109 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-0ccf1203-3083-44bf-865e-feb761a4aa6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:42.401082 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-0ccf1203-3083-44bf-865e-feb761a4aa6b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284498 Oct 02 00:47:42.401592 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Oct 2 00:47:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:47:45.025869 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-595d8446-ed7a-47a2-b62f-be68f7e2d27d admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:45.026933 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-595d8446-ed7a-47a2-b62f-be68f7e2d27d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 02 00:47:45.027516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:47:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:47:45.683414 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-c9a1873a-671c-41b9-a3ee-e4596a21ac8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:45.725727 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-c9a1873a-671c-41b9-a3ee-e4596a21ac8f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.684494 Oct 02 00:47:45.729003 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:47:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:45.738490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-eefa14fb-a408-4564-8d0d-1361575151fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:45.780307 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-eefa14fb-a408-4564-8d0d-1361575151fe admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045501 Oct 02 00:47:45.786437 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Oct 2 00:47:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:47:48.375787 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-c9a1873a-671c-41b9-a3ee-e4596a21ac8f admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:48.376878 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-c9a1873a-671c-41b9-a3ee-e4596a21ac8f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 02 00:47:48.377278 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:47:48.810689 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-0540a3a1-6f7b-43bb-a1b4-e3a5ecd3cc24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:48.830585 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-0540a3a1-6f7b-43bb-a1b4-e3a5ecd3cc24 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446541 Oct 02 00:47:48.831169 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:47:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:48.843380 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-b6fec83b-8ee7-4f23-8c0b-fa307e772d6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:48.871758 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-b6fec83b-8ee7-4f23-8c0b-fa307e772d6b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032207 Oct 02 00:47:48.872361 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Oct 2 00:47:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:47:51.473296 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-0540a3a1-6f7b-43bb-a1b4-e3a5ecd3cc24 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:51.474912 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-0540a3a1-6f7b-43bb-a1b4-e3a5ecd3cc24 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Oct 02 00:47:51.475325 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:47:51.890556 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-97d5c665-7040-4ff8-8c88-61285f53f26b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "ram": 2048, "id": "d3", "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:51.910771 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-97d5c665-7040-4ff8-8c88-61285f53f26b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429436 Oct 02 00:47:51.911488 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:47:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:51.923290 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-aa8c53c8-7466-4a54-a8ba-43c6852cf282 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:51.954517 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-aa8c53c8-7466-4a54-a8ba-43c6852cf282 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034898 Oct 02 00:47:51.965981 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Oct 2 00:47:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:47:54.548147 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-97d5c665-7040-4ff8-8c88-61285f53f26b admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:54.549188 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-97d5c665-7040-4ff8-8c88-61285f53f26b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Oct 02 00:47:54.549592 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:47:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:47:54.970951 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-ae8282b5-8db4-44d8-a3a5-05184b23c847 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "disk": 20}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:54.990280 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-ae8282b5-8db4-44d8-a3a5-05184b23c847 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434458 Oct 02 00:47:54.990880 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:47:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:47:55.005359 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-59cde6d2-3130-42fe-b1b6-04874f1ffbd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:47:55.034207 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-59cde6d2-3130-42fe-b1b6-04874f1ffbd8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032601 Oct 02 00:47:55.035039 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Oct 2 00:47:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:47:57.969761 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-ae8282b5-8db4-44d8-a3a5-05184b23c847 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:57.970832 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-ae8282b5-8db4-44d8-a3a5-05184b23c847 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Oct 02 00:47:57.971247 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:47:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:47:58.391478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-fc84ac1f-e8d9-4eda-80e8-2bb3cf369ed7 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:47:58.422759 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-fc84ac1f-e8d9-4eda-80e8-2bb3cf369ed7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.443544 Oct 02 00:47:58.423456 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Oct 2 00:47:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:48:01.003245 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-ae8282b5-8db4-44d8-a3a5-05184b23c847 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:01.004264 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-ae8282b5-8db4-44d8-a3a5-05184b23c847 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 02 00:48:01.004668 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:01.402336 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-743c904c-0100-4b0c-b6c8-00bdbb4fd9ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:01.421540 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-743c904c-0100-4b0c-b6c8-00bdbb4fd9ea admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.410872 Oct 02 00:48:01.422098 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:48:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:48:01.434651 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-07dcd88d-03f0-4a00-9ba2-1f3cf5bf6ccb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:01.461169 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-07dcd88d-03f0-4a00-9ba2-1f3cf5bf6ccb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030193 Oct 02 00:48:01.461727 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Oct 2 00:48:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:48:04.087023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-743c904c-0100-4b0c-b6c8-00bdbb4fd9ea admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:04.088278 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-743c904c-0100-4b0c-b6c8-00bdbb4fd9ea admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 02 00:48:04.088545 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:04.454860 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-400c0cbf-b374-4b75-8852-eee252ba0e28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "id": "2"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:04.473440 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-400c0cbf-b374-4b75-8852-eee252ba0e28 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.378963 Oct 02 00:48:04.473994 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:48:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:04.486404 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-0a0c82e7-f111-4973-808e-0d9154f2628f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:04.510999 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-0a0c82e7-f111-4973-808e-0d9154f2628f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028730 Oct 02 00:48:04.511674 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Oct 2 00:48:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:48:07.143897 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-400c0cbf-b374-4b75-8852-eee252ba0e28 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:07.144909 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-400c0cbf-b374-4b75-8852-eee252ba0e28 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 02 00:48:07.145315 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:48:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:07.705515 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-d01959b9-ac58-4d76-8ebe-106ed9074ea9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "disk": 40}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:07.727979 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-d01959b9-ac58-4d76-8ebe-106ed9074ea9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.576711 Oct 02 00:48:07.729091 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:48:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:07.740707 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-6f7dbe03-ed6d-4302-999c-40d3d02191a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:07.771182 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-6f7dbe03-ed6d-4302-999c-40d3d02191a7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034036 Oct 02 00:48:07.772075 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Oct 2 00:48:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:48:10.430897 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-d01959b9-ac58-4d76-8ebe-106ed9074ea9 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:10.432742 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-d01959b9-ac58-4d76-8ebe-106ed9074ea9 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002360 Oct 02 00:48:10.433141 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:10.899248 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-266b10fd-ca05-48f6-a6ca-b99a5f1d0e8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "id": "4", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:10.909410 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:10.921951 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-266b10fd-ca05-48f6-a6ca-b99a5f1d0e8b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.482666 Oct 02 00:48:10.922796 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:48:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:48:10.935451 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-8ecbb99a-f047-4ef1-ab83-5ddfb5481adf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:10.965454 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-8ecbb99a-f047-4ef1-ab83-5ddfb5481adf admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033872 Oct 02 00:48:10.966462 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Oct 2 00:48:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:48:13.641212 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-266b10fd-ca05-48f6-a6ca-b99a5f1d0e8b admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:13.642858 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-266b10fd-ca05-48f6-a6ca-b99a5f1d0e8b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Oct 02 00:48:13.648035 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:48:13 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:14.208767 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-a49e5be3-dd03-46f8-8117-71bf68190b9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "vcpus": 8}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:14.217376 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:14.231432 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-a49e5be3-dd03-46f8-8117-71bf68190b9e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.581928 Oct 02 00:48:14.232230 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Oct 2 00:48:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:14.246673 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-d13cc1d7-7dcc-44a4-bb4a-358117284fb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:14.274705 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-d13cc1d7-7dcc-44a4-bb4a-358117284fb8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033067 Oct 02 00:48:14.275332 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Oct 2 00:48:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:48:30.303339 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-a49e5be3-dd03-46f8-8117-71bf68190b9e admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:30.304354 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-a49e5be3-dd03-46f8-8117-71bf68190b9e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 02 00:48:30.304766 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:48:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:30.315630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:48:30.693413 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-876d96ac-de68-415c-b6a3-432e0c67c016 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:30.711138 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-876d96ac-de68-415c-b6a3-432e0c67c016 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400459 Oct 02 00:48:30.711677 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Oct 2 00:48:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:48:32.012595 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-a49e5be3-dd03-46f8-8117-71bf68190b9e admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:32.013598 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-a49e5be3-dd03-46f8-8117-71bf68190b9e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 02 00:48:32.013999 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:48:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:32.523443 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-3f845a38-fb2d-4861-9c73-8094682d8c4a admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:32.528698 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.wsgi [None req-3f845a38-fb2d-4861-9c73-8094682d8c4a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-3f845a38-fb2d-4861-9c73-8094682d8c4a admin admin] Request method failure captured: Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Accept: application/json Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Accept-Encoding: gzip, deflate Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Connection: keep-alive Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Content-Length: 0 Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Host: 10.222.0.25 Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Openstack-Api-Version: compute 2.92 Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Openstack-System-Scope: None Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: User-Agent: python-novaclient Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Auth-Token: gAAAAABjON_fbeDCJlgkFgag654UlYYHpaJE3WtmaXKP7f44JfgP-t8nO6qHuXpOI-tWkADCzi2lBAa2fXLvnA_XjTIb0uqbTCrWtrzjrhxpCdFaTi7hTQ13oH31NcVOWfZUG1tk-VaA8ChhX_FllELwcfvGuUVPpwnpV6qwv8oIebynzl__T5U Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Domain-Id: None Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Domain-Name: None Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Identity-Status: Confirmed Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Is-Admin-Project: True Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Domain-Id: default Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Domain-Name: Default Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Name: admin Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Role: member,admin,reader Oct 02 00:48:32.532435 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Roles: member,admin,reader Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}] Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Tenant: admin Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Tenant-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Tenant-Name: admin Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User: admin Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Domain-Id: default Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Domain-Name: Default Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Id: b3c5f8b9f24f40b99d0e28c5d77526fa Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Name: admin Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: method: > Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: exception: Flavor 42 could not be found. Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: action_args: {'id': '42'} Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:48:32.534107 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:32.536213 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.537516 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-3f845a38-fb2d-4861-9c73-8094682d8c4a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:48:32.538838 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-3f845a38-fb2d-4861-9c73-8094682d8c4a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.384362 Oct 02 00:48:32.538838 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Oct 2 00:48:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:32.543869 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-b1610297-341b-42b5-a4cc-156f2f80fe91 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:32.566989 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-b1610297-341b-42b5-a4cc-156f2f80fe91 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026723 Oct 02 00:48:32.567545 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Oct 2 00:48:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:48:32.577823 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-c19fd7cc-fbde-47e8-8e73-040f0ff94fe1 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:32.599637 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-c19fd7cc-fbde-47e8-8e73-040f0ff94fe1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026223 Oct 02 00:48:32.600158 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Oct 2 00:48:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:48:32.609245 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-5250b17b-e448-43b9-9a69-4442cc50bf54 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:32.615108 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.wsgi [None req-5250b17b-e448-43b9-9a69-4442cc50bf54 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-5250b17b-e448-43b9-9a69-4442cc50bf54 admin admin] Request method failure captured: Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Accept: application/json Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Accept-Encoding: gzip, deflate Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Connection: keep-alive Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Content-Length: 0 Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Host: 10.222.0.25 Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Openstack-Api-Version: compute 2.92 Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Openstack-System-Scope: None Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: User-Agent: python-novaclient Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Auth-Token: gAAAAABjON_fbeDCJlgkFgag654UlYYHpaJE3WtmaXKP7f44JfgP-t8nO6qHuXpOI-tWkADCzi2lBAa2fXLvnA_XjTIb0uqbTCrWtrzjrhxpCdFaTi7hTQ13oH31NcVOWfZUG1tk-VaA8ChhX_FllELwcfvGuUVPpwnpV6qwv8oIebynzl__T5U Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Domain-Id: None Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Domain-Name: None Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Identity-Status: Confirmed Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Is-Admin-Project: True Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Domain-Id: default Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Domain-Name: Default Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Name: admin Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Role: member,admin,reader Oct 02 00:48:32.618449 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Roles: member,admin,reader Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}] Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Tenant: admin Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Tenant-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Tenant-Name: admin Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User: admin Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Domain-Id: default Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Domain-Name: Default Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Id: b3c5f8b9f24f40b99d0e28c5d77526fa Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Name: admin Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: method: > Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: exception: Flavor 42 could not be found. Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: action_args: {'id': '42'} Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:48:32.619922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:32.620735 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:32.621741 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-5250b17b-e448-43b9-9a69-4442cc50bf54 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:48:32.622758 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-5250b17b-e448-43b9-9a69-4442cc50bf54 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014042 Oct 02 00:48:32.622758 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Oct 2 00:48:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:33.826362 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-c19fd7cc-fbde-47e8-8e73-040f0ff94fe1 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:33.827368 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-c19fd7cc-fbde-47e8-8e73-040f0ff94fe1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 02 00:48:33.827761 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:48:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:34.340998 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-ec6bb3cb-e9a3-4b8a-a3ed-84d48ee2bb8f admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:34.346600 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.wsgi [None req-ec6bb3cb-e9a3-4b8a-a3ed-84d48ee2bb8f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-ec6bb3cb-e9a3-4b8a-a3ed-84d48ee2bb8f admin admin] Request method failure captured: Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Accept: application/json Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Accept-Encoding: gzip, deflate Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Connection: keep-alive Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Content-Length: 0 Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Host: 10.222.0.25 Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Openstack-Api-Version: compute 2.92 Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Openstack-System-Scope: None Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: User-Agent: python-novaclient Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Auth-Token: gAAAAABjON_hskV18p2hOb0fNE55NORl9rNFkS04_y8doNAanBdA-pV3BmlljWL_jwmqM2VqVCmDPJ1l5HUwOAULgAv81C6WsJ1TDxqAzSy1oiM6m3ZD2_8j2SGA-uhLQUr3787-lmMCwqP0RNSa91eYWuI-YUceB25ILnrnteK5aJULQZvnHZY Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Domain-Id: None Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Domain-Name: None Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Identity-Status: Confirmed Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Is-Admin-Project: True Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Domain-Id: default Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Domain-Name: Default Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Name: admin Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Role: member,admin,reader Oct 02 00:48:34.348154 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Roles: member,admin,reader Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}] Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Tenant: admin Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Tenant-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Tenant-Name: admin Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User: admin Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Domain-Id: default Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Domain-Name: Default Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Id: b3c5f8b9f24f40b99d0e28c5d77526fa Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Name: admin Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: method: > Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: exception: Flavor 84 could not be found. Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: action_args: {'id': '84'} Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:48:34.349473 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:34.350286 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.351708 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-ec6bb3cb-e9a3-4b8a-a3ed-84d48ee2bb8f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:48:34.352933 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-ec6bb3cb-e9a3-4b8a-a3ed-84d48ee2bb8f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.385824 Oct 02 00:48:34.352933 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Oct 2 00:48:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:34.359281 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-68d7bc38-2fa0-4acb-8e2c-19f5ecf74d15 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:34.374662 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-68d7bc38-2fa0-4acb-8e2c-19f5ecf74d15 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018944 Oct 02 00:48:34.375179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Oct 2 00:48:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:48:34.384670 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-de5718f1-f5f3-4d7f-abed-14670a3d4909 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:34.400590 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-de5718f1-f5f3-4d7f-abed-14670a3d4909 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019416 Oct 02 00:48:34.401118 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Oct 2 00:48:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:48:34.410104 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-edc269f2-8907-41fc-b684-fd7fa5e8aa41 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:34.414969 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.wsgi [None req-edc269f2-8907-41fc-b684-fd7fa5e8aa41 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-edc269f2-8907-41fc-b684-fd7fa5e8aa41 admin admin] Request method failure captured: Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Accept: application/json Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Accept-Encoding: gzip, deflate Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Connection: keep-alive Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Content-Length: 0 Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Host: 10.222.0.25 Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Openstack-Api-Version: compute 2.92 Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Openstack-System-Scope: None Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: User-Agent: python-novaclient Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Auth-Token: gAAAAABjON_hskV18p2hOb0fNE55NORl9rNFkS04_y8doNAanBdA-pV3BmlljWL_jwmqM2VqVCmDPJ1l5HUwOAULgAv81C6WsJ1TDxqAzSy1oiM6m3ZD2_8j2SGA-uhLQUr3787-lmMCwqP0RNSa91eYWuI-YUceB25ILnrnteK5aJULQZvnHZY Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Domain-Id: None Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Domain-Name: None Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Identity-Status: Confirmed Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Is-Admin-Project: True Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Domain-Id: default Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Domain-Name: Default Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Name: admin Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Role: member,admin,reader Oct 02 00:48:34.416490 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Roles: member,admin,reader Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}] Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Tenant: admin Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Tenant-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Tenant-Name: admin Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User: admin Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Domain-Id: default Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Domain-Name: Default Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Id: b3c5f8b9f24f40b99d0e28c5d77526fa Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Name: admin Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: method: > Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: exception: Flavor 84 could not be found. Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: action_args: {'id': '84'} Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:48:34.418030 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:34.419124 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:34.420353 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-edc269f2-8907-41fc-b684-fd7fa5e8aa41 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:48:34.421528 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-edc269f2-8907-41fc-b684-fd7fa5e8aa41 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011146 Oct 02 00:48:34.421528 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Oct 2 00:48:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:35.632442 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-de5718f1-f5f3-4d7f-abed-14670a3d4909 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:35.633456 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-de5718f1-f5f3-4d7f-abed-14670a3d4909 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 02 00:48:35.633852 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:48:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:36.153752 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-8e2db4ee-fa93-4b08-9c0c-7c1127f55eae admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:36.160157 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.wsgi [None req-8e2db4ee-fa93-4b08-9c0c-7c1127f55eae admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-8e2db4ee-fa93-4b08-9c0c-7c1127f55eae admin admin] Request method failure captured: Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Accept: application/json Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Accept-Encoding: gzip, deflate Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Connection: keep-alive Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Content-Length: 0 Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Host: 10.222.0.25 Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Openstack-Api-Version: compute 2.92 Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Openstack-System-Scope: None Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: User-Agent: python-novaclient Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Auth-Token: gAAAAABjON_jJ1cSaMGIv_871RGwtw5OX4wjaW89AvousCNTDcWF6i4j-wsVgMaHoXjqCI8XSa1LqD-UlRMg2RFJh_3inHrHf2LU_RO6hn9Nhii8ULM9Ku-RqtxMDf0rcEN_MbvBXZfWHCTfOGBgDJZw0APmMbVpRFGI0j3wEuLhXe-VXGSLb5U Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Domain-Id: None Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Domain-Name: None Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Identity-Status: Confirmed Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Is-Admin-Project: True Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Domain-Id: default Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Domain-Name: Default Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Project-Name: admin Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Role: member,admin,reader Oct 02 00:48:36.161630 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Roles: member,admin,reader Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}] Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Tenant: admin Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Tenant-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-Tenant-Name: admin Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User: admin Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Domain-Id: default Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Domain-Name: Default Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Id: b3c5f8b9f24f40b99d0e28c5d77526fa Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: X-User-Name: admin Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: method: > Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: exception: Flavor 451 could not be found. Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: action_args: {'id': '451'} Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:48:36.163186 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:36.164126 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.165179 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-8e2db4ee-fa93-4b08-9c0c-7c1127f55eae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105448) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:48:36.166231 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-8e2db4ee-fa93-4b08-9c0c-7c1127f55eae admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391431 Oct 02 00:48:36.166231 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Oct 2 00:48:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 02 00:48:36.172873 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-128ff591-c6df-4f75-acce-2d13604e5c8c admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:36.189836 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-128ff591-c6df-4f75-acce-2d13604e5c8c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020578 Oct 02 00:48:36.190413 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Oct 2 00:48:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:48:36.200007 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:36.215019 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018576 Oct 02 00:48:36.215528 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Oct 2 00:48:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:48:36.225035 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-d630f08e-333b-4152-ac5d-bf418d856b0b admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:36.229958 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.wsgi [None req-d630f08e-333b-4152-ac5d-bf418d856b0b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-d630f08e-333b-4152-ac5d-bf418d856b0b admin admin] Request method failure captured: Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Accept: application/json Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Accept-Encoding: gzip, deflate Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Connection: keep-alive Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Content-Length: 0 Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Host: 10.222.0.25 Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Openstack-Api-Version: compute 2.92 Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Openstack-System-Scope: None Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: User-Agent: python-novaclient Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Auth-Token: gAAAAABjON_jJ1cSaMGIv_871RGwtw5OX4wjaW89AvousCNTDcWF6i4j-wsVgMaHoXjqCI8XSa1LqD-UlRMg2RFJh_3inHrHf2LU_RO6hn9Nhii8ULM9Ku-RqtxMDf0rcEN_MbvBXZfWHCTfOGBgDJZw0APmMbVpRFGI0j3wEuLhXe-VXGSLb5U Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Domain-Id: None Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Domain-Name: None Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Identity-Status: Confirmed Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Is-Admin-Project: True Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Openstack-Nova-Api-Version: 2.92 Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Domain-Id: default Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Domain-Name: Default Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Project-Name: admin Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Role: member,admin,reader Oct 02 00:48:36.231478 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Roles: member,admin,reader Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ea30d4949414e4cafefc43b9507a1d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ea30d4949414e4cafefc43b9507a1d0"}]}] Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Tenant: admin Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Tenant-Id: 2ea30d4949414e4cafefc43b9507a1d0 Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-Tenant-Name: admin Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User: admin Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Domain-Id: default Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Domain-Name: Default Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Id: b3c5f8b9f24f40b99d0e28c5d77526fa Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: X-User-Name: admin Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: method: > Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: exception: Flavor 451 could not be found. Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: action_args: {'id': '451'} Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:48:36.233022 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:36.234023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: ERROR nova.api.openstack.wsgi Oct 02 00:48:36.235163 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-d630f08e-333b-4152-ac5d-bf418d856b0b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:48:36.236181 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-d630f08e-333b-4152-ac5d-bf418d856b0b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011306 Oct 02 00:48:36.236181 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Oct 2 00:48:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 02 00:48:37.447864 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:37.448891 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 02 00:48:37.449284 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:37.966405 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-8fdca8ef-b418-4634-b364-48f3546eefb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:37.986744 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-8fdca8ef-b418-4634-b364-48f3546eefb2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398915 Oct 02 00:48:37.987300 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Oct 2 00:48:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:39.203627 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:39.204628 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 02 00:48:39.205028 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:39.721387 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-59c2d12e-4fd9-4836-9e4f-65538246c2ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:39.740200 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-59c2d12e-4fd9-4836-9e4f-65538246c2ce admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.396369 Oct 02 00:48:39.740755 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Oct 2 00:48:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 00:48:41.001944 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:41.002981 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 02 00:48:41.003378 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:41.521801 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-2ee55a85-11c3-4215-9543-8567753bc597 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:41.541109 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-2ee55a85-11c3-4215-9543-8567753bc597 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398607 Oct 02 00:48:41.541634 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Oct 2 00:48:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:42.773613 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:42.774652 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 02 00:48:42.775076 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:43.292883 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-00b33c85-7e7a-4840-a270-f3073b284468 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:48:43.312107 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-00b33c85-7e7a-4840-a270-f3073b284468 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397847 Oct 02 00:48:43.312662 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Oct 2 00:48:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:48:44.542707 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:44.543719 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 02 00:48:44.544114 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:48:45.060867 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-866ed297-ae7d-4d4a-a415-0f1dba16d14f admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:48:45.084172 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-866ed297-ae7d-4d4a-a415-0f1dba16d14f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402886 Oct 02 00:48:45.084716 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Sun Oct 2 00:48:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:49:41.477794 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:41.478757 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-208cfc23-7795-4ebd-9bdf-b7e34ecb6219 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 02 00:49:41.479159 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Sun Oct 2 00:49:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:49:41.490173 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:41.869386 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-e838384d-5be0-44aa-adb3-8d60e7671197 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:41.889970 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-e838384d-5be0-44aa-adb3-8d60e7671197 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404283 Oct 02 00:49:41.890525 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Oct 2 00:49:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:49:41.910903 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:SELECT=14 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:49:41.914615 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-436bfe15-d760-41f1-9f21-8f0b1ce9ab1d admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:41.922481 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-436bfe15-d760-41f1-9f21-8f0b1ce9ab1d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013034 Oct 02 00:49:41.923003 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Sun Oct 2 00:49:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:49:41.934426 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-cbe45e86-15ca-4034-b8e5-327b87eb9adb admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:41.942121 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-cbe45e86-15ca-4034-b8e5-327b87eb9adb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011157 Oct 02 00:49:41.942634 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Sun Oct 2 00:49:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:49:41.953625 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:41.960597 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010424 Oct 02 00:49:41.961095 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Sun Oct 2 00:49:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:49:41.972457 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-295d146b-1504-4524-8d69-f7c6c1d611b2 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:49:41.979428 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-295d146b-1504-4524-8d69-f7c6c1d611b2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010422 Oct 02 00:49:41.979940 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Sun Oct 2 00:49:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:52:36.674067 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:36.675096 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 02 00:52:36.675489 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:36.814578 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_api:SELECT=6 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:36.971908 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-13c8607b-6947-49be-bc99-5d6a5a39710c admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:36.976564 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-13c8607b-6947-49be-bc99-5d6a5a39710c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:52:36.977027 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-13c8607b-6947-49be-bc99-5d6a5a39710c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:52:36.978131 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-13c8607b-6947-49be-bc99-5d6a5a39710c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:52:36.978837 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-13c8607b-6947-49be-bc99-5d6a5a39710c admin admin] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:52:36.979278 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-13c8607b-6947-49be-bc99-5d6a5a39710c admin admin] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:52:36.979683 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-13c8607b-6947-49be-bc99-5d6a5a39710c admin admin] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:52:37.011366 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-13c8607b-6947-49be-bc99-5d6a5a39710c admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197970 Oct 02 00:52:37.011922 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Oct 2 00:52:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:52:38.103915 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:38.104921 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 02 00:52:38.105459 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:38.295087 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-5b970c5c-1f96-4519-8d4f-5e05e0e66e4d admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:38.298550 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-5b970c5c-1f96-4519-8d4f-5e05e0e66e4d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:52:38.299023 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-5b970c5c-1f96-4519-8d4f-5e05e0e66e4d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:52:38.299452 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-5b970c5c-1f96-4519-8d4f-5e05e0e66e4d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:52:38.300162 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-5b970c5c-1f96-4519-8d4f-5e05e0e66e4d admin admin] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:52:38.300605 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-5b970c5c-1f96-4519-8d4f-5e05e0e66e4d admin admin] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:52:38.301016 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-5b970c5c-1f96-4519-8d4f-5e05e0e66e4d admin admin] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:52:38.320798 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-5b970c5c-1f96-4519-8d4f-5e05e0e66e4d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.074924 Oct 02 00:52:38.321934 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Oct 2 00:52:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:52:49.769039 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:49.770090 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 02 00:52:49.770480 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:49.913318 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_cell0:SELECT=4 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:49.914028 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_cell1:SELECT=4 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:49.914649 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG dbcounter [-] [105447] Writing DB stats nova_api:SELECT=8 {{(pid=105447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:52:49.961630 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-7012e500-9403-45d4-825a-a56509e3da18 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:49.965676 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-7012e500-9403-45d4-825a-a56509e3da18 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:52:49.966173 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-7012e500-9403-45d4-825a-a56509e3da18 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:52:49.966594 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-7012e500-9403-45d4-825a-a56509e3da18 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:52:49.967292 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-7012e500-9403-45d4-825a-a56509e3da18 admin admin] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:52:49.967729 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-7012e500-9403-45d4-825a-a56509e3da18 admin admin] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:52:49.968136 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-7012e500-9403-45d4-825a-a56509e3da18 admin admin] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:52:49.992402 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-7012e500-9403-45d4-825a-a56509e3da18 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.083494 Oct 02 00:52:49.992943 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Oct 2 00:52:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:52:51.081648 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG nova.api.openstack.wsgi [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] Calling method '>' {{(pid=105448) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:51.082698 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: INFO nova.api.openstack.requestlog [None req-e31114ba-fd62-470f-9e29-a278ffa1ad6f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 02 00:52:51.083098 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: [pid: 105448|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Oct 2 00:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:52:51.272722 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG nova.api.openstack.wsgi [None req-c77c28f1-215b-4cc7-855b-3085234e9c79 admin admin] Calling method '>' {{(pid=105447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:52:51.276657 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-c77c28f1-215b-4cc7-855b-3085234e9c79 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:52:51.277121 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-c77c28f1-215b-4cc7-855b-3085234e9c79 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:52:51.277548 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-c77c28f1-215b-4cc7-855b-3085234e9c79 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:52:51.278293 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-c77c28f1-215b-4cc7-855b-3085234e9c79 admin admin] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:52:51.278738 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-c77c28f1-215b-4cc7-855b-3085234e9c79 admin admin] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:52:51.279147 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: DEBUG oslo_concurrency.lockutils [None req-c77c28f1-215b-4cc7-855b-3085234e9c79 admin admin] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:52:51.301054 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: INFO nova.api.openstack.requestlog [None req-c77c28f1-215b-4cc7-855b-3085234e9c79 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.078671 Oct 02 00:52:51.301540 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: [pid: 105447|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Oct 2 00:52:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:53:50.529978 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: Sun Oct 2 00:53:50 2022 - graceful shutdown triggered... Oct 02 00:53:50.530480 dv-cinder-master-3-iscsi devstack@n-api.service[105447]: Gracefully killing worker 1 (pid: 105447)... Oct 02 00:53:50.530127 dv-cinder-master-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 02 00:53:50.531267 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: Gracefully killing worker 2 (pid: 105448)... Oct 02 00:53:50.658515 dv-cinder-master-3-iscsi devstack@n-api.service[105448]: DEBUG dbcounter [-] [105448] Writing DB stats nova_api:SELECT=4 {{(pid=105448) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:53:51.530430 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: worker 1 buried after 1 seconds Oct 02 00:53:51.530951 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: worker 2 buried after 1 seconds Oct 02 00:53:51.530951 dv-cinder-master-3-iscsi devstack@n-api.service[105446]: goodbye to uWSGI. Oct 02 00:53:51.531979 dv-cinder-master-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 02 00:53:51.532541 dv-cinder-master-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 02 00:53:51.535320 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 02 00:53:51.546772 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 2 00:53:51 2022] *** Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: nodename: dv-cinder-master-3-iscsi Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: machine: x86_64 Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: clock source: unix Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: pcre jit disabled Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: detected number of CPU cores: 4 Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: current working directory: / Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: detected binary path: /usr/bin/uwsgi-core Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: your processes number limit is 47680 Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: your memory page size is 4096 bytes Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: detected max file descriptor number: 2048 Oct 02 00:53:51.548875 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: lock engine: pthread robust mutexes Oct 02 00:53:51.549819 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: thunder lock: enabled Oct 02 00:53:51.549819 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 02 00:53:51.549819 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 02 00:53:51.589308 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: Python main interpreter initialized at 0x555af5d6d9c0 Oct 02 00:53:51.589308 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: python threads support enabled Oct 02 00:53:51.589308 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: your server socket listen backlog is limited to 100 connections Oct 02 00:53:51.589308 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: your mercy for graceful operations on workers is 90 seconds Oct 02 00:53:51.589754 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: mapped 403077 bytes (393 KB) for 2 cores Oct 02 00:53:51.589754 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: *** Operational MODE: preforking *** Oct 02 00:53:51.590033 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: *** uWSGI is running in multiple interpreter mode *** Oct 02 00:53:51.590033 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: spawned uWSGI master process (pid: 120406) Oct 02 00:53:51.590254 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 02 00:53:51.590836 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: spawned uWSGI worker 1 (pid: 120424, cores: 1) Oct 02 00:53:51.591351 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: spawned uWSGI worker 2 (pid: 120425, cores: 1) Oct 02 00:53:51.591628 dv-cinder-master-3-iscsi devstack@n-api.service[120406]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 02 00:53:52.261865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:53:52.262463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 02 00:53:53.434578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:53:53.434578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: from cryptography.utils import int_from_bytes Oct 02 00:53:53.435281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:53:53.435281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: from cryptography.utils import int_from_bytes Oct 02 00:53:53.435674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:53:53.435674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: from cryptography.utils import int_from_bytes Oct 02 00:53:53.436097 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 02 00:53:53.436097 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: from cryptography.utils import int_from_bytes Oct 02 00:53:55.883768 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:53:55.884298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:53:55.884586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:53:55.884850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:53:55.885114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:53:55.885511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.885694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 02 00:53:55.886116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.886198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 02 00:53:55.886292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.886479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 02 00:53:55.886583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.886812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 02 00:53:55.886925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.887093 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 02 00:53:55.887196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.887439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.887539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.887761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.887869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.888082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.888192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.888343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.888441 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.888683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.888776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.889012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.889118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.889332 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.889465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.889642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.889831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.890013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.890190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.890335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.890506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.890665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.890816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.890989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.891145 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.891303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.891506 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.891665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.891817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.891988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.893133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.893133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.893595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.893804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.894010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.894278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.894496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.894496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.894921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.895151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.895365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.895570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.895798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.895798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.896221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.896221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.896643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.896643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.897066 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.897272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.897489 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.897695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.897913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.898251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.898460 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.898672 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.898831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.899014 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.899170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.899356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.899505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.899659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.899815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.901377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.901599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.901767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.901924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.902106 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.902274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.902436 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.902592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.902743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.902892 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.903042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.903186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.903340 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.903496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.903640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.903788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.903977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.904161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.904334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.904486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.905415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.905586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.905742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.905889 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.906046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.906240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.906403 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.906548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.906548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.906847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.906998 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.907164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.907164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.907438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.907589 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.907744 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.907893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.908045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.908045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.908332 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.908484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.908641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.908785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.908945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.909096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.909241 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.909396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.909547 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.909547 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.909821 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.909972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.910674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.910835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.911174 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.911337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.911482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.911670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.911833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.911978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.912127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.912275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.912439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.912591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.912748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.912902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.913053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.913205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.913360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.913502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.913658 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.914360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.914522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.914674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.914825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.914978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.915128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.915278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.915429 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.915571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.915739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.915898 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.916049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.916201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.916354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.916498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.916642 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.916806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.916965 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.917114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.917264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.917407 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.917557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.917720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.918468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.918632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.918632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.918913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.919065 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.919215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.919364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.919520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.919693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.919845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.920012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.920155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.920817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.920985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.921162 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.922020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.922246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.922401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.922561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.922706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.922875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.923150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.923302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.923466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.923626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.923626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.923907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.924056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.924209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.924360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.924521 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.924671 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.924816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.924958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.925109 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.925260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.925428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.925572 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.925572 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.925858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.926002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.926179 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.926342 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.926496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.926640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.926789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.926789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.927080 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.927233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.927387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.927529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.927679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.927830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.927986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.928130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.928279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.928437 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.928580 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.928722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.928873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.929016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.929174 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.929324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.929549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.930212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.930957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.931115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.931266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.931537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.931683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.931683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.932106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.932106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.932329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.932329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.932544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.932670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.932795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.932907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.933017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.933222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.933356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.933458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.933583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.933694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.933810 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.933925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.934094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.934225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.934334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.934422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.934515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.934606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.934698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.934831 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.934924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935194 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935374 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.935992 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.936085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.936176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.936268 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.936362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.936446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.936530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.936613 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 02 00:53:55.936696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.936784 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.936876 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.936876 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.937938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938412 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938596 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.938962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939145 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.939956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.940038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.940130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.940216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.940216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.940368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.940450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.940561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.940804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.941066 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.941154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.941243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.941334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.941429 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.941523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.941675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.941763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.941897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.942949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943358 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.943971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944062 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944776 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.944959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.945899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.946133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.946232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.946457 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.946564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.946773 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.946879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.947088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.947184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.947401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.947492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.947708 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.947807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.948013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.948106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.948320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.948410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.948630 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.948733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.948935 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.949034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.949258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.949351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.949588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.949690 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.949896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.950000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.950240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.950334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.950557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.950648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.950876 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.951000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.951230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.951333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.951487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.951587 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.951792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.951889 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.952105 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.952230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.952414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.952540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.952722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.952855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.953033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.953171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.953346 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.953484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.953654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.953795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.953961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.954172 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.954313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.954442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.954614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.954758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.954933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.955077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.955252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.955371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.955563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.955687 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.955880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.956010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.956199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.956324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.956517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.956643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.956829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.956946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.957143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.957268 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.957479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.957603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.957810 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.957936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.958166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.958476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.958610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.958786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.959001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.959135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.959400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.959525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.959726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.959859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.960035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.960154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.960459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.960604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.960755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.960903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.961095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.961393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.961543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.961682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.961801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.962098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.962233 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.962374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.962510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.962647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.962776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.962920 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.963052 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.963188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.963317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.963453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.963590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.963732 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.963869 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.963999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.964129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.964264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.964407 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.964544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.964673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.964809 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.964939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.965132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.965274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.965465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.965605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.965789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.965928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.966136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.966290 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.966457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.966597 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.966778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.966911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.967098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.967245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.967418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.967550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.967746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.967893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.968056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.968195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.968372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.968504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.968686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.968816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.968998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.969137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.969322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.969463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.969649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.969779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.969960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.970124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.970318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.970463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.970656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.970794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.970965 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.971113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.971453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.971593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.971724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.971853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.971991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.972220 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.972360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.972541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.972675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.972857 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.972996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.973171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.973317 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.973487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.973618 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.973798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.973930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.974132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.974278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.974448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.974583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.974759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.974901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.975082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.975216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.975394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.975528 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.975713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.975848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.976020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.976157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.976868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.977021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.977189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.977331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.977513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.977647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.977819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.977961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.978157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.978292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.978487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.978626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.978808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.978950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.979118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.979251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.979434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.979566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.979743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.979965 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.980106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.980242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.980372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.980506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.980649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.980779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.980958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.981097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.981264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.981617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.981617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.981886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.981886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.982263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.982385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.982518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.982657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.982794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.982930 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.983058 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.983186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.983320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.983462 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.983591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.983725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.983853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.983981 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.984127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.984263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.984390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.984579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.984711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.984895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.985042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.985221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.985352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.985544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.985683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.985850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.985989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.986180 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.986322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.986492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.986622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.986802 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.986941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.987110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.987241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.987416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.987556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.987721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.987861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.988066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.988198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.988381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.988509 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.988690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.988827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.989011 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.989148 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.989332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.989465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.989645 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.989775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.989962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.990124 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.990301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.990432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.990620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.990757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.990940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.991086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.991263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.991410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.991736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.991877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.992059 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.992191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.992320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.992470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.992613 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.992751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.992888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.993025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.993161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.993304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.993435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.993572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.993743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.993876 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.994102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.994383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.994526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.994699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.994834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.995020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.995168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.995374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.995591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.995733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.995927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.996069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.996246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.996379 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.996567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.996709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.996913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.997055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.997493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.997644 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.997834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.997974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.998185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.998318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.998499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.998645 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.998806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.998946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.999116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.999247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.999422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.999569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.999727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:55.999859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.000036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.000175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.000344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.000476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.000655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.000787 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.000976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.001112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.001255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.001393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.001569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.001896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.001896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.002176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.002345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.002485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.002616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.002734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.002862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.002998 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.003137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.003267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.003402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.003532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.003664 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.003803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.003974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.004108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.004288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.004421 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.004598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.004746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.004906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.005041 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.005213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.005354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.005557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.005700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.005864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.005999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.006254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.006388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.006588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.006730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.006901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.007051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.007212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.007345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.007515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.008164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.008357 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.008496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.008675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.008816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.008986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.009128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.009305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.009439 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.009616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.009749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.009952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.010104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.010238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.010367 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.010546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.010680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.010860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.010995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.011167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.011299 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.011475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.011615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.011956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.012101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.012240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.012368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.012493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.012638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.012776 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.012900 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.013028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.013185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.013325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.013469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.013595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.013723 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.013883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.014016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.014231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.014376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.014543 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.014677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.014852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.014987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.015159 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.015293 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.015975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.016134 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.016267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.016396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.016542 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.016680 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.016680 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.016936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.017066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.017194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.017401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.017536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.017666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.017803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.017932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.018119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.018119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.018384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.018384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.018630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.018759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.018898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.019028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.019158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.019286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.019422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.019559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.019700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.019838 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.019969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.020106 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.020243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.020381 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.020521 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.020659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.020797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.020928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.021065 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.021195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.021334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.021472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.021615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.021747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.021899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.022253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.022390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.022508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.022631 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.022767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.022898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.023034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.023192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.023848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.023971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.024140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.024273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.024451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.024593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.024802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.031641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.031833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.031833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.032133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.032486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.032619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.032749 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.032887 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.033032 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.033172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.033310 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.033448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.033448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.033699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.033699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.033961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.033961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.034249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.034390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.034520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.034658 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.034788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.034928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.035609 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.035745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.035893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.036024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.036159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.036290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.036426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.036556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.036698 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.036829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.036959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.036959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.037218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.037218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.037486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.037623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.037762 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.037898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.038027 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.038196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.038337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.038468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.038604 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.038733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.038888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.039028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.039159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.039301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.039438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.039570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.039706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.039848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.039980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.040109 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.040237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.040374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.040517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.040655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.040791 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.040921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.041057 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.041187 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.041326 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.041464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.041595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.041725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.041861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.041991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.042173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.042320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.042669 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.042811 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.042941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.043078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.043222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.043360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.043495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.043634 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.043765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.043909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.044053 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.044189 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.044326 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.044463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.044592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.044735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.044871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.045582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.045721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.045863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.045995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.046155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.046271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.046401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.046539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.046670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.046799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.046938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.047068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.047198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.047335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.047465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.047602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.047734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.047862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.047999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.048129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.048265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.048404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.048542 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.048674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.048804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.048932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.049063 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.049201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.049339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.049477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.049606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.049736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.049867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.050005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.050183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.050327 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.050459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.050598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.050738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.050869 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.050999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.051138 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.051268 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.051404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.051611 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.051744 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.051744 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.051998 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.052128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.052257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.052257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.052725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.052849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.052978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.053114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.053253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.053398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.053541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.053680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.053809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.053948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.054093 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.054238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.054376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.054530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.054662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.054805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.054947 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.055078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.055206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.055346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.055490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.055622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.055751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.055887 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.056025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.056155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.056298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.056430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.056559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.056688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.056816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.056816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.057073 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.057211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.057348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.057479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.057608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.057743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.057887 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.058018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.058175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.058305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.058447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.058589 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.058720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.058850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.058978 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.059107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.059236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.059236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.059490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.059490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.059744 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.059882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.060019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.060159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.060290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.060419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.060557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.060687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.060816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.060954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.061091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.061221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.061358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.061494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.061638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.061768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.061904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.062034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.062192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.062331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.062470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.062813 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.062941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.063080 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.063219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.063357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.063496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.063634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.063764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.063893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.064022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.064158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.064302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.064443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.064582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.064720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.064854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.064992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.065122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.065259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.065397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.065527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.065664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.065804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.065942 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.066124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.066269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.066408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.066539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.066683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.066823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.066962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.067092 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.067227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.067364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.067502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.067634 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.067770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.067901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.068037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.068176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.068307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.068443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.068573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.068701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.068837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.068981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.069112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.069240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.069376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.069513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.069643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.069781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.069920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.070574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.070710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.070852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.070990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.071205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.071339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.071476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.071606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.071735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.071873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.072004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.072134 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.072270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.072400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.072529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.072668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.073013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.073154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.073285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.073423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.073561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.073700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.073832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.073969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.073969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.074260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.074391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.074537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.074675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.074806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.074943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.075081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.075222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.075356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.075492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.075629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.075766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.075904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.075904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.076159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.076290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.076426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.076562 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.076692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.076830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.076960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.077097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.077234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.077372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.077503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.077645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.077783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.077919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.078107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.078107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.078373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.078505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.078633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.078775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.078905 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.079034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.079172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.079172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.079419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.079556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.079685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.079815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.079951 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.080082 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.080211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.080340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.080470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.080599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.080736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.080874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.080874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.081125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.081255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.081402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.081542 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.081679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.081679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.081924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.082077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.082227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.082359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.082496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.082634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.082764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.082764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.083225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.083225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.083466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.083607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.083744 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.083885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.084014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.084149 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.084277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.084404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.084545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.084689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.084811 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.084921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.085030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.085155 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.085282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.085398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.085516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.085636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.086364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.086508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.086653 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.086787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.086923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.087053 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.087182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.087320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.087451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.087581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.087710 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.087847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.087977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.088120 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.088251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.088380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.088522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.088653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.088782 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.088921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.089052 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.089187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.089318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.089447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.089447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.089720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.089849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.089979 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.090133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.090273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.090273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.090541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.090672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.090801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.090938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.091067 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.091209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.091353 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.091491 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.091620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.091749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.091877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.092016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.092154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.092290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.092420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.092549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.092687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.092818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.092947 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.093292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.093422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.093552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.093691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.093829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.093960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.094117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.094261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.094261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.094518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.094649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.094779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.094906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.095042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.095174 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.095316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.095649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.095789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.095971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.096105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.096283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.096425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.096613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.096748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.096928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.097071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.097279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.097411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.097549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.097686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.097845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.097987 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.098176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.098322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.098485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.098616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.098798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.098937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.099111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.099252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.099415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.099554 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.099719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.099867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.100027 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.100165 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.100334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.100466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.100637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.100784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.100946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.101127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.101284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.101434 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.101571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.101709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.101881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.102022 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.102219 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.102349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.102485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.102624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.102799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.102931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.103111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.103275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.103421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.103570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.103727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.103871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.104032 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.104173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.104347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.104490 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.104653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.104787 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.105049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.105183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.105357 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.105497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.105743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.105892 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.106036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.106185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.106333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.106474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.106605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.106736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.106925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.107066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.107237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.107368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.107543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.107676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.107859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.108003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.108167 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.108301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.108492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.108627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.108805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.109040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.109183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.109382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.109516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.109709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.109851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.110050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.110292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.110427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.110628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.110762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.110949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.111084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.111281 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.111416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.111618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.111756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.111922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.112055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.112228 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.112369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.112531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.112672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.112852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.112985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.113163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.113500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.113500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.113751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.113751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.114008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.114155 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.114286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.114415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.114553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.114684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.114813 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.115004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.115139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.115319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.115461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.115627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.115787 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.115981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.116113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.116255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.116385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.116515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.116644 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.116822 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.116993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.117141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.117272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.117462 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.117596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.117803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.117936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.118147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.118284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.118470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.118616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.118790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.118922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.119245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.119397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.119530 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.119661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.119789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.119928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.120068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.120206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.120338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.120468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.120605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.120745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.120926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.121070 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.121239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.121375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.121549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.121692 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.121963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.122127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.122627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.122762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.122907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.123040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.123177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.123322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.123648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.123790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.123931 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.124061 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.124197 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.124327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.124463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.124593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.124736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.124872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.125002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.125137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.125311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.125457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.125650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.125790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.125985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.126157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.126335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.126519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.126623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.126713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.126932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.127086 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.127240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.127389 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.127549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.127690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.127864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.128008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.128175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.128315 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.128478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.128618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.128782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.128924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.129089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.129221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.129393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.129526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.129698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.129830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.129999 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.130152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.130325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.130461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.130635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.130770 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.130938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.131073 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.131239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.131380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.131548 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.131694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.131849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.131993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.132132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.132270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.132437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.133080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.133256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.133390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.133734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.133916 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.134102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.134256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.134386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.134515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.134644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.134774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.134910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.135055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.135193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.135330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.135460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.135590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.135727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.135857 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.135987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.136202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.136335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.136473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.136617 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.136748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.136877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.137015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.137196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.137331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.137518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.137661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.137830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.137964 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.138165 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.138300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.138503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.138646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.138815 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.138960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.139128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.139273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.139444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.139584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.139756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.139897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.140067 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.140212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.140377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.140517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.140703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.140843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.141039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.141201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.141335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.141465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.141640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.141773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.141964 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.142156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.142290 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.142420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.142610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.142754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.142921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.143055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.143248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.143381 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.143558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.143900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.144044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.144176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.144313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.144444 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.144580 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.144720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.144851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.144981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.145111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.145241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.145377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.145517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.145656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.145787 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.145954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.146107 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.146293 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.146441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.146620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.146761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.146944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.147078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.147253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.147387 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.147578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.147712 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.147903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.148043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.148829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.148979 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.149146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.149280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.149456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.149595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.149736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:53:56.149875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.150126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.150442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.150750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 02 00:53:56.150992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 02 00:53:56.212334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO dbcounter [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Registered counter for database nova_api Oct 02 00:53:56.212918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO dbcounter [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Registered counter for database nova_api Oct 02 00:53:56.232711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:53:56.234200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_db.sqlalchemy.engines [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:53:56.239569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:53:56.240928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writer thread running {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:53:56.296304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.context [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3c3637e-55d8-46cc-8af5-7f3f543268bb(cell1) {{(pid=120425) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:53:56.297458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.context [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3c3637e-55d8-46cc-8af5-7f3f543268bb(cell1) {{(pid=120424) load_cells /opt/stack/nova/nova/context.py:464}} Oct 02 00:53:56.300356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:53:56.300836 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:53:56.301463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:53:56.301945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:53:56.302455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:53:56.303194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:53:56.303574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:53:56.303686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:53:56.304309 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:53:56.305300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:53:56.306203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:53:56.307343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:53:56.308192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO dbcounter [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Registered counter for database nova_cell0 Oct 02 00:53:56.309346 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO dbcounter [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Registered counter for database nova_cell0 Oct 02 00:53:56.312273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO dbcounter [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Registered counter for database nova_cell1 Oct 02 00:53:56.313632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO dbcounter [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Registered counter for database nova_cell1 Oct 02 00:53:56.320840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:53:56.322634 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:53:56.324212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_db.sqlalchemy.engines [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:53:56.325549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_db.sqlalchemy.engines [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:53:56.326613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:53:56.332160 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writer thread running {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:53:56.333789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writer thread running {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:53:56.472489 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:53:56.481469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO dbcounter [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Registered counter for database nova_cell0 Oct 02 00:53:56.481747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO dbcounter [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Registered counter for database nova_cell0 Oct 02 00:53:56.490470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_db.sqlalchemy.engines [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:53:56.490765 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 02 00:53:56.495756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:53:56.496133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writer thread running {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 02 00:53:56.820495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: WARNING keystonemiddleware.auth_token [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:53:56.827902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: WARNING keystonemiddleware.auth_token [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:53:56.833010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:53:56.840660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:53:57.182430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: WARNING keystonemiddleware.auth_token [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:53:57.189147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: WARNING keystonemiddleware.auth_token [None req-b1d2f869-4d75-46fb-b73c-2e17ef4d4287 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:53:57.194520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555af5d6d9c0 pid: 120424 (default app) Oct 02 00:53:57.218079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 02 00:53:57.224115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-626303d4-47f2-4f28-b448-bfd1fa226169 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 02 00:53:57.230206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555af5d6d9c0 pid: 120425 (default app) Oct 02 00:54:31.456677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:31.457495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:31.458466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:31.459741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:32.567101 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ed9e6cdb-1460-4bf2-b618-d39c3c7c90fd tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Action: 'create', calling method: .version_select at 0x7f6e79ee54c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1842450643"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:33.029603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:33.031143 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:33.031867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:33.032768 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:34.499878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ed34195-8d44-4323-bd1c-5746526b682c tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Action: 'create', calling method: .version_select at 0x7f6e79ee45e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1283712527", "metadata": {"Type": "work"}}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:34.903095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ed9e6cdb-1460-4bf2-b618-d39c3c7c90fd tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.464526 Oct 02 00:54:34.904956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Sun Oct 2 00:54:31 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3468 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 02 00:54:34.921172 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ad9cd67a-3165-4d10-b364-7f1b97a24d98 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79db83a0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:35.104918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ad9cd67a-3165-4d10-b364-7f1b97a24d98 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51" status: 200 len: 345 microversion: 2.1 time: 0.188790 Oct 02 00:54:35.105518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:34 2022] GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 => generated 345 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:36.119734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-46971067-475a-4c5c-a330-e39fa0ad4ca3 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79db8af0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:36.481285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-46971067-475a-4c5c-a330-e39fa0ad4ca3 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51" status: 200 len: 346 microversion: 2.1 time: 0.366139 Oct 02 00:54:36.491924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 3/3] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:36 2022] GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 => generated 346 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:36.498859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eeb0841d-c1ef-4490-8a76-cd86929558e9 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Action: 'create', calling method: .version_select at 0x7f6e79d51160>, body: {"snapshot": {"volume_id": "99de30a1-abed-4d94-a498-26eac766fc51", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-170132504"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:36.742435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ed34195-8d44-4323-bd1c-5746526b682c tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.722847 Oct 02 00:54:36.743688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1/4] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Oct 2 00:54:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3726 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 02 00:54:36.760346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1f143aa8-1d20-4f70-909e-7fdd963bcc3a tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Calling method '.version_select at 0x7f6e79db84c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:37.525770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eeb0841d-c1ef-4490-8a76-cd86929558e9 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.032285 Oct 02 00:54:37.528496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 4/5] 10.222.0.25 () {60 vars in 1162 bytes} [Sun Oct 2 00:54:36 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:37.541272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-55878196-cb13-43a7-8209-6e0ad87f0b04 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79d51940>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:37.687932 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1f143aa8-1d20-4f70-909e-7fdd963bcc3a tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64" status: 200 len: 354 microversion: 2.1 time: 0.932762 Oct 02 00:54:37.688788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2/6] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:36 2022] GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64 => generated 354 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:54:37.702218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b4b0717c-10a0-4677-aa99-3f6cdea38b67 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Calling method '.version_select at 0x7f6e79db8b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:38.002889 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-55878196-cb13-43a7-8209-6e0ad87f0b04 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 200 len: 286 microversion: 2.1 time: 0.467195 Oct 02 00:54:38.003627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 5/7] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 00:54:37 2022] GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 286 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:54:38.014049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b4b0717c-10a0-4677-aa99-3f6cdea38b67 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64" status: 200 len: 354 microversion: 2.1 time: 0.316052 Oct 02 00:54:38.014745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3/8] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:37 2022] GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64 => generated 354 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:54:38.015504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-48f3b39c-f0ff-4d0b-a9e4-34873c2c0b42 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79d510d0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:38.029802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c09e0ed4-0af2-4bc4-8eb9-217c7410a0c2 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Calling method '.version_select at 0x7f6e79d52280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:38.819815 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-48f3b39c-f0ff-4d0b-a9e4-34873c2c0b42 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.808526 Oct 02 00:54:38.821453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 6/9] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Oct 2 00:54:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:54:38.831828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c1d90fd4-c7e0-4f44-bf9b-8cb67d6b2378 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79db8160>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:38.941704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c09e0ed4-0af2-4bc4-8eb9-217c7410a0c2 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64" status: 202 len: 0 microversion: 2.1 time: 0.916691 Oct 02 00:54:38.942776 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 4/10] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 00:54:38 2022] DELETE /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64 => generated 0 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:54:38.951279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10aec890-f030-47a3-ba33-d30b393cec70 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Calling method '.version_select at 0x7f6e79db8dc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:39.130569 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c1d90fd4-c7e0-4f44-bf9b-8cb67d6b2378 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 200 len: 286 microversion: 2.1 time: 0.302443 Oct 02 00:54:39.136028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 7/11] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 00:54:38 2022] GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 286 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:54:39.250991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10aec890-f030-47a3-ba33-d30b393cec70 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64" status: 200 len: 353 microversion: 2.1 time: 0.303770 Oct 02 00:54:39.252610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 5/12] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:38 2022] GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64 => generated 353 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:40.159733 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-033ca927-1e2c-4753-90ef-d5c5e31d4138 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79db88b0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:40.229179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-033ca927-1e2c-4753-90ef-d5c5e31d4138 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 200 len: 286 microversion: 2.1 time: 0.088168 Oct 02 00:54:40.230267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 00:54:40 2022] GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:54:40.268252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e172c8e-72c5-492f-83ba-4caf40c8afb0 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Calling method '.version_select at 0x7f6e79db8700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:40.376721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e172c8e-72c5-492f-83ba-4caf40c8afb0 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64" status: 200 len: 353 microversion: 2.1 time: 0.111517 Oct 02 00:54:40.379029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 6/14] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:40 2022] GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:41.242962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5ad5fd67-768f-4992-a299-88b26581485c tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e7a713940>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:41.305960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5ad5fd67-768f-4992-a299-88b26581485c tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 200 len: 286 microversion: 2.1 time: 0.067218 Oct 02 00:54:41.306893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 9/15] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 00:54:41 2022] GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:41.393996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-039f16ee-41b9-4592-aa29-df0d179c5317 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Calling method '.version_select at 0x7f6e79d52430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:41.514071 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-039f16ee-41b9-4592-aa29-df0d179c5317 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64" status: 200 len: 353 microversion: 2.1 time: 0.125077 Oct 02 00:54:41.514766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 7/16] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:41 2022] GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64 => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:42.319989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d363eb06-9ade-4c42-8a6d-5221981b1358 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79d51040>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:42.373971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d363eb06-9ade-4c42-8a6d-5221981b1358 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 200 len: 287 microversion: 2.1 time: 0.058511 Oct 02 00:54:42.374974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 10/17] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 00:54:42 2022] GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:42.386651 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11484027-3b04-4fb9-b7dc-3a34f1c42b8f tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79db8670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:42.527749 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-71c40fd6-f3a0-496f-adc9-1578cbe14cf3 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Calling method '.version_select at 0x7f6e79db8430>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:42.531669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11484027-3b04-4fb9-b7dc-3a34f1c42b8f tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 202 len: 0 microversion: 2.1 time: 0.147404 Oct 02 00:54:42.532570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 8/18] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Oct 2 00:54:42 2022] DELETE /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:54:42.540492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-075871f0-1ff0-48b2-8ff1-510c9a67ca9d tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79db8dc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:42.615748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-71c40fd6-f3a0-496f-adc9-1578cbe14cf3 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] HTTP exception thrown: Volume 086984c6-4a88-462f-b906-f6546fdefe64 could not be found. Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-71c40fd6-f3a0-496f-adc9-1578cbe14cf3 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Request method failure captured: Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64 HTTP/1.1 Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFI8TpnpiRdPbvJxHHPh4zQpoIJA1iUiVBCO1bu_RTUKPVUVjiYu3iCMqvC2dyWhLts8mRmZyz9GwIar_6I-lIfJhd00s8_Vfo_O4xRt9pIXo6cCW3Y3jzDk_0H5Ci8PoTTKdyQU5wkZHL5n0aR4bvMTI-yOyH44LMefeTTYgpZZUY Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 2b5d5f73035444e3959e308137a08fe6 Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesGetTestJSON-1473856736 Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:54:42.623236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2b5d5f73035444e3959e308137a08fe6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2b5d5f73035444e3959e308137a08fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2b5d5f73035444e3959e308137a08fe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2b5d5f73035444e3959e308137a08fe6"}]}] Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesGetTestJSON-1473856736 Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 2b5d5f73035444e3959e308137a08fe6 Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesGetTestJSON-1473856736 Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesGetTestJSON-1473856736-project Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: c041f6984d154f60aeb151677f1b04b8 Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesGetTestJSON-1473856736-project Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Volume 086984c6-4a88-462f-b906-f6546fdefe64 could not be found. Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '086984c6-4a88-462f-b906-f6546fdefe64'} Oct 02 00:54:42.624307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 086984c6-4a88-462f-b906-f6546fdefe64 could not be found. (HTTP 404) (Request-ID: req-ded51861-c8bb-4a23-bbf9-741764b48371) Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:42.624958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:42.625852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 086984c6-4a88-462f-b906-f6546fdefe64 could not be found. Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 00:54:42.626776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 086984c6-4a88-462f-b906-f6546fdefe64 could not be found. Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 086984c6-4a88-462f-b906-f6546fdefe64 could not be found. Oct 02 00:54:42.627668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:42.633653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-71c40fd6-f3a0-496f-adc9-1578cbe14cf3 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] Returning 404 to user: Volume 086984c6-4a88-462f-b906-f6546fdefe64 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:42.634974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-71c40fd6-f3a0-496f-adc9-1578cbe14cf3 tempest-VolumesGetTestJSON-1473856736 tempest-VolumesGetTestJSON-1473856736-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64" status: 404 len: 109 microversion: 2.1 time: 0.110928 Oct 02 00:54:42.636686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 11/19] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:42 2022] GET /compute/v2.1/os-volumes/086984c6-4a88-462f-b906-f6546fdefe64 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:54:42.661366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-075871f0-1ff0-48b2-8ff1-510c9a67ca9d tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 200 len: 286 microversion: 2.1 time: 0.124586 Oct 02 00:54:42.662755 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 9/20] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 00:54:42 2022] GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:43.510171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1779678090", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "networks": [{"uuid": "74133d68-ccbb-4f42-9e67-bdbe71ca1352"}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:43.675882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db0f4205-6ce4-4e7e-b5ad-a8778ecee8e1 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79d520d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:43.723900 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] validate_networks() for [('74133d68-ccbb-4f42-9e67-bdbe71ca1352', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:54:43.743482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db0f4205-6ce4-4e7e-b5ad-a8778ecee8e1 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 200 len: 286 microversion: 2.1 time: 0.072356 Oct 02 00:54:43.744448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 10/21] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 00:54:43 2022] GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:44.759251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8ab9f918-89c2-4543-81ac-56cc8eaa3926 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79db8ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:44.834603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8ab9f918-89c2-4543-81ac-56cc8eaa3926 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 200 len: 286 microversion: 2.1 time: 0.079673 Oct 02 00:54:44.840264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 11/22] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 00:54:44 2022] GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:45.725234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-253672761", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:45.778170 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:54:45.783142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:54:45.784088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:54:45.784622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:54:45.785144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:54:45.844231 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:45.844728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:45.851685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:45.852519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:45.860271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:45.861143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:45.906920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Getting quotas for project 3e983e7eb1474850a440d1e022c7c5a9. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:54:45.915469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Getting quotas for user ee548b86b214493e83a00964137c4fde and project 3e983e7eb1474850a440d1e022c7c5a9. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:54:45.946378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] validate_networks() for [('ac5bd4ad-3b24-4909-a4c7-09b260f667cc', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:54:45.959640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:54:45.963002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:54:46.158626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-59055fde-fa2a-4a9c-a762-df113e3731ac tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.095093 Oct 02 00:54:46.163257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 12/23] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 00:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:54:46.180864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5cd70d19-be04-46bd-93a4-3b48d78d3fd3 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e79c3d1f0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:46.258796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-5cd70d19-be04-46bd-93a4-3b48d78d3fd3 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] HTTP exception thrown: Snapshot e823547d-8e3f-452f-9716-bdac56ea4072 could not be found. Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5cd70d19-be04-46bd-93a4-3b48d78d3fd3 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Request method failure captured: Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 HTTP/1.1 Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFHQLd4KK48RPoQ7n98vyuqFlL4NKYjeTAUbRyKBc-EAwik0UBpwt04VRqIyPkYV9lbpyXYCK5y7t76e12Ddpm_G4MOmOPiSSeVkcPq9fyc8ktI9B6pfvg41fspiD9P0cqpTUxWHyCKEjLJLi5HWSSNm9emAAWosXa3qPrHmiZCQaU Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 9a3b40887e3b44478be649dfaa3f0322 Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:54:46.261461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a3b40887e3b44478be649dfaa3f0322"}]}] Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 9a3b40887e3b44478be649dfaa3f0322 Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesSnapshotsTestJSON-1171684899-project Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: a852bc2fda7a479e879b7803d24530a0 Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1171684899-project Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Snapshot e823547d-8e3f-452f-9716-bdac56ea4072 could not be found. Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': 'e823547d-8e3f-452f-9716-bdac56ea4072'} Oct 02 00:54:46.262598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e823547d-8e3f-452f-9716-bdac56ea4072 could not be found. (HTTP 404) (Request-ID: req-c67811aa-b659-4f68-8e90-245d91676098) Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:46.263212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:46.264056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e823547d-8e3f-452f-9716-bdac56ea4072 could not be found. Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 02 00:54:46.265322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e823547d-8e3f-452f-9716-bdac56ea4072 could not be found. Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e823547d-8e3f-452f-9716-bdac56ea4072 could not be found. Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5cd70d19-be04-46bd-93a4-3b48d78d3fd3 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Returning 404 to user: Snapshot e823547d-8e3f-452f-9716-bdac56ea4072 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:46.266666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5cd70d19-be04-46bd-93a4-3b48d78d3fd3 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072" status: 404 len: 111 microversion: 2.1 time: 0.097815 Oct 02 00:54:46.273426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 13/24] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 00:54:46 2022] GET /compute/v2.1/os-snapshots/e823547d-8e3f-452f-9716-bdac56ea4072 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:54:46.292623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ff9ba3ed-b350-40af-80d5-e8522be08711 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:46.295771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ff9ba3ed-b350-40af-80d5-e8522be08711 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:46.460385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ff9ba3ed-b350-40af-80d5-e8522be08711 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:46.493537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ff9ba3ed-b350-40af-80d5-e8522be08711 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1215 microversion: 2.1 time: 0.218979 Oct 02 00:54:46.494527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 14/25] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:46 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:54:46.501747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9a79ee1a-61d9-4ef8-a648-0bb5879c9de7 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e793d58b0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:46.612027 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9a79ee1a-61d9-4ef8-a648-0bb5879c9de7 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51" status: 202 len: 0 microversion: 2.1 time: 0.116325 Oct 02 00:54:46.615749 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 15/26] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 00:54:46 2022] DELETE /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:54:46.621369 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5541487c-1ef2-4a77-a3b4-1a376cfc4ac1 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e793f3ca0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:46.717319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5541487c-1ef2-4a77-a3b4-1a376cfc4ac1 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51" status: 200 len: 345 microversion: 2.1 time: 0.100217 Oct 02 00:54:46.717889 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 16/27] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:46 2022] GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:47.141311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cce5db42-8524-4f46-bc67-9f79089f7981 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'create', calling method: .version_select at 0x7f6e793f4310>, body: {"keypair": {"name": "tempest-keypair-761101838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyFOSviNbQPP9k/r4X8xCyvZcTo3Xj9RZFrRkkeZaj3msF70ZdM3Hs7YTIf2+G3PUvwhoKLaHr06VG9RzJXp8CpIQrZvvBl6J4eqnhVEr5JQr0ZH66o4EKcG2MMJjfPqQ=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:47.178845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-cce5db42-8524-4f46-bc67-9f79089f7981 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Getting quotas for project ff4aef28dfc444ee914b56c64b2edb77. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:54:47.188761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-cce5db42-8524-4f46-bc67-9f79089f7981 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Getting quotas for user a8894fd1044241ee8ba84927b6e8326a and project ff4aef28dfc444ee914b56c64b2edb77. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:54:47.274726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cce5db42-8524-4f46-bc67-9f79089f7981 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.554250 Oct 02 00:54:47.283759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 17/28] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Oct 2 00:54:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 558 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 00:54:47.524836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-53d19fab-df77-4940-a0e8-7136edb533d2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:47.525475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-53d19fab-df77-4940-a0e8-7136edb533d2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:47.919562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-53d19fab-df77-4940-a0e8-7136edb533d2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:47.929895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-53d19fab-df77-4940-a0e8-7136edb533d2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1215 microversion: 2.1 time: 0.408788 Oct 02 00:54:47.930617 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 18/29] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:47 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1215 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:54:47.936295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e7da87c4-3399-4304-a94d-d4ffd8f00bfe tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e793f3790>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:48.020108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e7da87c4-3399-4304-a94d-d4ffd8f00bfe tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51" status: 200 len: 345 microversion: 2.1 time: 0.087909 Oct 02 00:54:48.022195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 19/30] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:47 2022] GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:54:48.110636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:54:48.111104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:54:48.111547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:54:48.112088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:54:48.112526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:54:48.160968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:48.161468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:48.162494 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:48.170661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:48.173748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:48.174250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:48.250700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Getting quotas for project 4c22ffb83d7d41828375606fcc6da53f. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:54:48.264030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Getting quotas for user afe98894d83f4678bb134782d90706e8 and project 4c22ffb83d7d41828375606fcc6da53f. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:54:48.268447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2dae48a9-1476-425d-8690-7ab904f231f7 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Action: 'create', calling method: .version_select at 0x7f6e793a8280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-905813173", "metadata": {"Type": "work"}}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2dae48a9-1476-425d-8690-7ab904f231f7 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Request method failure captured: Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 121 Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFXDnaaxvCe3Ob7xA8UqylHsc9Bspnhdh1IcXD7LgNwJ-J8IXGk_ruDfUN9eExjM99pthU2DUF1lF6I6PjnxrsJIAtnMwI5qfSRKApcAUxqep5AQDghWWIxWy31NZxoCOlMViPyCLKbm-CuMeQDyQdza3Wr5v2m60-qqXI3lIyA-AQ Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:54:48.276820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}] Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: b71c040b0fcc4a8a91379722f7e79e4a Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-905813173", "metadata": {"Type": "work"}}} Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: Oct 02 00:54:48.278200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-905813173', 'metadata': {'Type': 'work'}}}} Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise error Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi '#$%' Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:48.279132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 00:54:48.280284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 00:54:48.281274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 02 00:54:48.281274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.281274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2dae48a9-1476-425d-8690-7ab904f231f7 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:48.283404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2dae48a9-1476-425d-8690-7ab904f231f7 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.259879 Oct 02 00:54:48.283941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 20/31] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Oct 2 00:54:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 00:54:48.299311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:54:48.304578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:54:48.305445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1c7fd1fd-7ae0-4d80-8d06-1e5767bd6320 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Action: 'create', calling method: .version_select at 0x7f6e79c3dd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2046465179", "metadata": {"Type": "work"}}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1c7fd1fd-7ae0-4d80-8d06-1e5767bd6320 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Request method failure captured: Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 120 Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFXDnaaxvCe3Ob7xA8UqylHsc9Bspnhdh1IcXD7LgNwJ-J8IXGk_ruDfUN9eExjM99pthU2DUF1lF6I6PjnxrsJIAtnMwI5qfSRKApcAUxqep5AQDghWWIxWy31NZxoCOlMViPyCLKbm-CuMeQDyQdza3Wr5v2m60-qqXI3lIyA-AQ Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:54:48.318893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}] Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: b71c040b0fcc4a8a91379722f7e79e4a Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2046465179", "metadata": {"Type": "work"}}} Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: Oct 02 00:54:48.320038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2046465179', 'metadata': {'Type': 'work'}}}} Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise error Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi '0' Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:48.320759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 00:54:48.322445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 00:54:48.323324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 02 00:54:48.323324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.323324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1c7fd1fd-7ae0-4d80-8d06-1e5767bd6320 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:48.323324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1c7fd1fd-7ae0-4d80-8d06-1e5767bd6320 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025262 Oct 02 00:54:48.329877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 21/32] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Oct 2 00:54:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 00:54:48.342771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-94a924c9-61d3-4da5-bd83-744552fb5e25 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Action: 'create', calling method: .version_select at 0x7f6e793d51f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681413028", "metadata": {"Type": "work"}}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-94a924c9-61d3-4da5-bd83-744552fb5e25 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Request method failure captured: Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 118 Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFXDnaaxvCe3Ob7xA8UqylHsc9Bspnhdh1IcXD7LgNwJ-J8IXGk_ruDfUN9eExjM99pthU2DUF1lF6I6PjnxrsJIAtnMwI5qfSRKApcAUxqep5AQDghWWIxWy31NZxoCOlMViPyCLKbm-CuMeQDyQdza3Wr5v2m60-qqXI3lIyA-AQ Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:54:48.355472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}] Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: b71c040b0fcc4a8a91379722f7e79e4a Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681413028", "metadata": {"Type": "work"}}} Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: Oct 02 00:54:48.356880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-681413028', 'metadata': {'Type': 'work'}}}} Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise error Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi '' Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:48.357677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 02 00:54:48.359107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 02 00:54:48.360425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 02 00:54:48.360425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.360425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-94a924c9-61d3-4da5-bd83-744552fb5e25 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:48.360425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-94a924c9-61d3-4da5-bd83-744552fb5e25 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025790 Oct 02 00:54:48.365567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 22/33] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Oct 2 00:54:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 00:54:48.371439 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-38ad46b3-41ef-4e1b-bfc6-92fd06704807 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Calling method '.version_select at 0x7f6e793f4a60>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:48.455094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-69112e7a-41d8-44fb-b0e9-832eabe4a870 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.393347 Oct 02 00:54:48.460428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 12/34] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 00:54:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 3397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 00:54:48.466114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-38ad46b3-41ef-4e1b-bfc6-92fd06704807 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] HTTP exception thrown: Volume tempest-invalid-1752582033 could not be found. Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-38ad46b3-41ef-4e1b-bfc6-92fd06704807 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Request method failure captured: Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1752582033 HTTP/1.1 Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFXDnaaxvCe3Ob7xA8UqylHsc9Bspnhdh1IcXD7LgNwJ-J8IXGk_ruDfUN9eExjM99pthU2DUF1lF6I6PjnxrsJIAtnMwI5qfSRKApcAUxqep5AQDghWWIxWy31NZxoCOlMViPyCLKbm-CuMeQDyQdza3Wr5v2m60-qqXI3lIyA-AQ Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:54:48.468060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}] Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: b71c040b0fcc4a8a91379722f7e79e4a Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Volume tempest-invalid-1752582033 could not be found. Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': 'tempest-invalid-1752582033'} Oct 02 00:54:48.469099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1752582033 could not be found. (HTTP 404) (Request-ID: req-f59b8743-1f4b-47b7-a401-c2ddfbdbbd3c) Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.469752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:54:48.470740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1752582033 could not be found. Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:54:48.471668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1752582033 could not be found. Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1752582033 could not be found. Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-38ad46b3-41ef-4e1b-bfc6-92fd06704807 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Returning 404 to user: Volume tempest-invalid-1752582033 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-38ad46b3-41ef-4e1b-bfc6-92fd06704807 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1752582033" status: 404 len: 99 microversion: 2.1 time: 0.102400 Oct 02 00:54:48.475741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 23/35] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Oct 2 00:54:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1752582033 => generated 99 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 02 00:54:48.478005 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a3cbe48-b374-4c4b-ab83-bf75a6e5d42c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:48.478005 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a3cbe48-b374-4c4b-ab83-bf75a6e5d42c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:48.482470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-57b139a9-7dcf-4259-b32b-4dd4c485cfbb tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006837 Oct 02 00:54:48.494810 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 24/36] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Oct 2 00:54:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 02 00:54:48.499884 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-20a1ae0e-abbb-4b34-9095-98a88b9fd193 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003962 Oct 02 00:54:48.500409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 25/37] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Oct 2 00:54:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 02 00:54:48.519267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a3ec2a07-07a2-4893-87c9-6078bc533a08 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Calling method '.version_select at 0x7f6e793ab700>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:48.604413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-a3ec2a07-07a2-4893-87c9-6078bc533a08 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] HTTP exception thrown: Volume e6326ed1-addb-402d-aff4-ed9ae63f7b92 could not be found. Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a3ec2a07-07a2-4893-87c9-6078bc533a08 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Request method failure captured: Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/os-volumes/e6326ed1-addb-402d-aff4-ed9ae63f7b92 HTTP/1.1 Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFXDnaaxvCe3Ob7xA8UqylHsc9Bspnhdh1IcXD7LgNwJ-J8IXGk_ruDfUN9eExjM99pthU2DUF1lF6I6PjnxrsJIAtnMwI5qfSRKApcAUxqep5AQDghWWIxWy31NZxoCOlMViPyCLKbm-CuMeQDyQdza3Wr5v2m60-qqXI3lIyA-AQ Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:54:48.612939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}] Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: b71c040b0fcc4a8a91379722f7e79e4a Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Volume e6326ed1-addb-402d-aff4-ed9ae63f7b92 could not be found. Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': 'e6326ed1-addb-402d-aff4-ed9ae63f7b92'} Oct 02 00:54:48.614294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6326ed1-addb-402d-aff4-ed9ae63f7b92 could not be found. (HTTP 404) (Request-ID: req-cac231ec-5f8e-417e-af0a-3699685ab846) Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.615636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:54:48.616614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6326ed1-addb-402d-aff4-ed9ae63f7b92 could not be found. Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 02 00:54:48.619695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6326ed1-addb-402d-aff4-ed9ae63f7b92 could not be found. Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6326ed1-addb-402d-aff4-ed9ae63f7b92 could not be found. Oct 02 00:54:48.624017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.633649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a3ec2a07-07a2-4893-87c9-6078bc533a08 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Returning 404 to user: Volume e6326ed1-addb-402d-aff4-ed9ae63f7b92 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:48.636336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a3ec2a07-07a2-4893-87c9-6078bc533a08 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e6326ed1-addb-402d-aff4-ed9ae63f7b92" status: 404 len: 109 microversion: 2.1 time: 0.120799 Oct 02 00:54:48.647651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 26/38] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 00:54:48 2022] DELETE /compute/v2.1/os-volumes/e6326ed1-addb-402d-aff4-ed9ae63f7b92 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:54:48.673619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-20d48e42-dfc7-49f5-8d28-16d795e1a614 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Calling method '.version_select at 0x7f6e793abca0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:48.686021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a3cbe48-b374-4c4b-ab83-bf75a6e5d42c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:48.737610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a3cbe48-b374-4c4b-ab83-bf75a6e5d42c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1221 microversion: 2.1 time: 0.269793 Oct 02 00:54:48.740077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 13/39] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:48 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:54:48.770648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-20d48e42-dfc7-49f5-8d28-16d795e1a614 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] HTTP exception thrown: Volume 98b3b4d5-849e-41f9-acbd-362436988aa5 could not be found. Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-20d48e42-dfc7-49f5-8d28-16d795e1a614 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Request method failure captured: Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/os-volumes/98b3b4d5-849e-41f9-acbd-362436988aa5 HTTP/1.1 Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFXDnaaxvCe3Ob7xA8UqylHsc9Bspnhdh1IcXD7LgNwJ-J8IXGk_ruDfUN9eExjM99pthU2DUF1lF6I6PjnxrsJIAtnMwI5qfSRKApcAUxqep5AQDghWWIxWy31NZxoCOlMViPyCLKbm-CuMeQDyQdza3Wr5v2m60-qqXI3lIyA-AQ Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:54:48.776046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81e2ad2846234ee999dd454bdea3299f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81e2ad2846234ee999dd454bdea3299f"}]}] Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 81e2ad2846234ee999dd454bdea3299f Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-VolumesNegativeTest-776516536 Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: b71c040b0fcc4a8a91379722f7e79e4a Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-VolumesNegativeTest-776516536-project Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Volume 98b3b4d5-849e-41f9-acbd-362436988aa5 could not be found. Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '98b3b4d5-849e-41f9-acbd-362436988aa5'} Oct 02 00:54:48.777217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98b3b4d5-849e-41f9-acbd-362436988aa5 could not be found. (HTTP 404) (Request-ID: req-8c15e409-dffa-4164-8690-75ef203e3f91) Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.777860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:48.778854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98b3b4d5-849e-41f9-acbd-362436988aa5 could not be found. Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 00:54:48.779763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98b3b4d5-849e-41f9-acbd-362436988aa5 could not be found. Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98b3b4d5-849e-41f9-acbd-362436988aa5 could not be found. Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:54:48.780646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-20d48e42-dfc7-49f5-8d28-16d795e1a614 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] Returning 404 to user: Volume 98b3b4d5-849e-41f9-acbd-362436988aa5 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:48.781837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-20d48e42-dfc7-49f5-8d28-16d795e1a614 tempest-VolumesNegativeTest-776516536 tempest-VolumesNegativeTest-776516536-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/98b3b4d5-849e-41f9-acbd-362436988aa5" status: 404 len: 109 microversion: 2.1 time: 0.132495 Oct 02 00:54:48.785539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 27/40] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:48 2022] GET /compute/v2.1/os-volumes/98b3b4d5-849e-41f9-acbd-362436988aa5 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:54:48.955928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:48.956505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:48.973123 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:48.976015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:48.977154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:48.978524 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:48.981054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:48.985762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:49.012551 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-595407563", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:49.243721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] validate_networks() for [('ac5bd4ad-3b24-4909-a4c7-09b260f667cc', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:54:49.566700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:49.591341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d70a67e9-a512-41ce-8088-7c7c716b0bd2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1211 microversion: 2.1 time: 0.639822 Oct 02 00:54:49.593316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 14/41] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:48 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1211 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:54:49.599176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15734108-6555-4b4f-a0ff-7b8a4d069754 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e7938b160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:49.683102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-15734108-6555-4b4f-a0ff-7b8a4d069754 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] HTTP exception thrown: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15734108-6555-4b4f-a0ff-7b8a4d069754 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Request method failure captured: Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 HTTP/1.1 Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFHQLd4KK48RPoQ7n98vyuqFlL4NKYjeTAUbRyKBc-EAwik0UBpwt04VRqIyPkYV9lbpyXYCK5y7t76e12Ddpm_G4MOmOPiSSeVkcPq9fyc8ktI9B6pfvg41fspiD9P0cqpTUxWHyCKEjLJLi5HWSSNm9emAAWosXa3qPrHmiZCQaU Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 9a3b40887e3b44478be649dfaa3f0322 Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 00:54:49.687503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a3b40887e3b44478be649dfaa3f0322"}]}] Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 9a3b40887e3b44478be649dfaa3f0322 Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotsTestJSON-1171684899-project Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: a852bc2fda7a479e879b7803d24530a0 Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1171684899-project Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '99de30a1-abed-4d94-a498-26eac766fc51'} Oct 02 00:54:49.688616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. (HTTP 404) (Request-ID: req-4129fb29-43da-488a-a535-1cda2b67ef91) Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:49.689295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:49.690327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 00:54:49.696142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15734108-6555-4b4f-a0ff-7b8a4d069754 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Returning 404 to user: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15734108-6555-4b4f-a0ff-7b8a4d069754 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51" status: 404 len: 109 microversion: 2.1 time: 0.094968 Oct 02 00:54:49.698588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 15/42] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:49 2022] GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:54:49.710977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87c27582-f773-446b-b39b-a8e14a2a9746 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e7939a820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:49.840422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-87c27582-f773-446b-b39b-a8e14a2a9746 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] HTTP exception thrown: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87c27582-f773-446b-b39b-a8e14a2a9746 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Request method failure captured: Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 HTTP/1.1 Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFHQLd4KK48RPoQ7n98vyuqFlL4NKYjeTAUbRyKBc-EAwik0UBpwt04VRqIyPkYV9lbpyXYCK5y7t76e12Ddpm_G4MOmOPiSSeVkcPq9fyc8ktI9B6pfvg41fspiD9P0cqpTUxWHyCKEjLJLi5HWSSNm9emAAWosXa3qPrHmiZCQaU Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 9a3b40887e3b44478be649dfaa3f0322 Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 00:54:49.843138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a3b40887e3b44478be649dfaa3f0322"}]}] Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 9a3b40887e3b44478be649dfaa3f0322 Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotsTestJSON-1171684899-project Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: a852bc2fda7a479e879b7803d24530a0 Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1171684899-project Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '99de30a1-abed-4d94-a498-26eac766fc51'} Oct 02 00:54:49.844567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. (HTTP 404) (Request-ID: req-ebc8f3e8-e8e9-4ad5-8e53-da4fe052f791) Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:49.845329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 02 00:54:49.846347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 02 00:54:49.847282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87c27582-f773-446b-b39b-a8e14a2a9746 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Returning 404 to user: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:49.848684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87c27582-f773-446b-b39b-a8e14a2a9746 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51" status: 404 len: 109 microversion: 2.1 time: 0.143782 Oct 02 00:54:49.849415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 16/43] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 00:54:49 2022] DELETE /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:54:49.854374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de10f036-36d4-4d91-b8f9-aeeb025ebf81 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Calling method '.version_select at 0x7f6e7939a550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:50.007056 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-de10f036-36d4-4d91-b8f9-aeeb025ebf81 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] HTTP exception thrown: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de10f036-36d4-4d91-b8f9-aeeb025ebf81 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Request method failure captured: Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 HTTP/1.1 Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFHQLd4KK48RPoQ7n98vyuqFlL4NKYjeTAUbRyKBc-EAwik0UBpwt04VRqIyPkYV9lbpyXYCK5y7t76e12Ddpm_G4MOmOPiSSeVkcPq9fyc8ktI9B6pfvg41fspiD9P0cqpTUxWHyCKEjLJLi5HWSSNm9emAAWosXa3qPrHmiZCQaU Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 9a3b40887e3b44478be649dfaa3f0322 Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 00:54:50.009029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a3b40887e3b44478be649dfaa3f0322"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a3b40887e3b44478be649dfaa3f0322"}]}] Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 9a3b40887e3b44478be649dfaa3f0322 Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1171684899 Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotsTestJSON-1171684899-project Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: a852bc2fda7a479e879b7803d24530a0 Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1171684899-project Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '99de30a1-abed-4d94-a498-26eac766fc51'} Oct 02 00:54:50.010192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. (HTTP 404) (Request-ID: req-1d0df6b2-de31-4080-89fb-656538f36816) Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:50.010840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 02 00:54:50.011822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 02 00:54:50.012741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de10f036-36d4-4d91-b8f9-aeeb025ebf81 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] Returning 404 to user: Volume 99de30a1-abed-4d94-a498-26eac766fc51 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de10f036-36d4-4d91-b8f9-aeeb025ebf81 tempest-VolumesSnapshotsTestJSON-1171684899 tempest-VolumesSnapshotsTestJSON-1171684899-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51" status: 404 len: 109 microversion: 2.1 time: 0.160545 Oct 02 00:54:50.013747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 17/44] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:54:49 2022] GET /compute/v2.1/os-volumes/99de30a1-abed-4d94-a498-26eac766fc51 => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:54:50.615239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:50.616667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:50.631334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:50.637492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:50.639469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:50.644035 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:50.644619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:50.652094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:50.882054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:50.904028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f677d28-fac1-4ba6-8f51-449ae7e3d997 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1273 microversion: 2.1 time: 0.285613 Oct 02 00:54:50.904694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 18/45] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:50 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:54:51.935955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:51.936674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:51.947922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:51.952017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:51.955289 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:51.968744 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:51.980405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:51.981271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:52.374180 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:54:52.374806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:54:52.375070 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:54:52.375494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:54:52.375902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:54:52.390779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:52.394655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:52.395194 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:52.395629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:52.407636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b50f87a9-00c3-4a14-b544-f47a363b3a4c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1273 microversion: 2.1 time: 0.472195 Oct 02 00:54:52.408956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:52.426173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 19/46] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:51 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1273 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:54:52.435656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:52.436112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:52.507481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Getting quotas for project 4c22ffb83d7d41828375606fcc6da53f. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:54:52.523640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Getting quotas for user afe98894d83f4678bb134782d90706e8 and project 4c22ffb83d7d41828375606fcc6da53f. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:54:52.605585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:54:52.608992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:54:52.761449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d816f429-82e5-424c-82c3-0e5c4fb8ed74 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.754053 Oct 02 00:54:52.775163 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f77d8f7-d107-4b52-9332-83c6af274151 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:52.775791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f77d8f7-d107-4b52-9332-83c6af274151 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:52.787333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 28/47] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 00:54:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:54:53.285097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f77d8f7-d107-4b52-9332-83c6af274151 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:53.298863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f77d8f7-d107-4b52-9332-83c6af274151 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1221 microversion: 2.1 time: 0.528590 Oct 02 00:54:53.303068 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 20/48] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:52 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1221 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:54:53.443870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:53.445162 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:53.461038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:53.464182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:53.464981 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:53.466651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:53.469468 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:53.471768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:54.295846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:54.327511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:54.328132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:54.335769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:54.336284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:54.336719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:54.340093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:54.340742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:54.343444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-981aac62-33ad-430e-9b68-e492a9900e5c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1273 microversion: 2.1 time: 0.902087 Oct 02 00:54:54.344120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:54.369610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 29/49] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:53 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1273 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:54:54.752086 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:54.761604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5db4b8a6-492c-453b-a0bf-42ef3d208bf2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1225 microversion: 2.1 time: 0.437875 Oct 02 00:54:54.773957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 21/50] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:54 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1225 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:54:55.390047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:55.390719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:55.410397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:55.412082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:55.412536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:55.417261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:55.428902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:55.429493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:55.703277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1073841911", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dfcbc66-8cd7-466b-a451-fff57570319b"}], "security_groups": [{"name": "tempest-securitygroup--1967435273"}], "key_name": "tempest-keypair-761101838", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:57.941244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] validate_networks() for [('5dfcbc66-8cd7-466b-a451-fff57570319b', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:54:58.207477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:54:59.291318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:59.302157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bf8e4c5f-0b10-4aeb-8698-77fa0c546d9b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 3.915576 Oct 02 00:54:59.323722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 30/51] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:55 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 3938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:54:59.330626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:54:59.331782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:54:59.343830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:59.345170 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:59.346502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:59.348952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:59.349978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:59.351373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:54:59.546425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:54:59.573184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-90e257c0-7ce5-4d20-a8e7-7d73d77b9cea tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1279 microversion: 2.1 time: 0.245994 Oct 02 00:54:59.576502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 31/52] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:54:59 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:54:59.931127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-6286b740-4f93-4146-bd0a-2febc81323ec req-69a06e5c-55f5-4cd5-95ac-d3431ff2a5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd2929d-fbbf-498d-881f-142ede942767", "tag": "f0316a21-607f-46f6-b48c-57949a51bc86"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:54:59.947767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6286b740-4f93-4146-bd0a-2febc81323ec req-69a06e5c-55f5-4cd5-95ac-d3431ff2a5d8 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:54:59.948521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6286b740-4f93-4146-bd0a-2febc81323ec req-69a06e5c-55f5-4cd5-95ac-d3431ff2a5d8 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:54:59.949230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6286b740-4f93-4146-bd0a-2febc81323ec req-69a06e5c-55f5-4cd5-95ac-d3431ff2a5d8 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:00.000263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-6286b740-4f93-4146-bd0a-2febc81323ec req-69a06e5c-55f5-4cd5-95ac-d3431ff2a5d8 service nova] Creating event network-changed:f0316a21-607f-46f6-b48c-57949a51bc86 for instance abd2929d-fbbf-498d-881f-142ede942767 on hv-cinder-maste Oct 02 00:55:00.001594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6286b740-4f93-4146-bd0a-2febc81323ec req-69a06e5c-55f5-4cd5-95ac-d3431ff2a5d8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120424) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 00:55:00.002986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6286b740-4f93-4146-bd0a-2febc81323ec req-69a06e5c-55f5-4cd5-95ac-d3431ff2a5d8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120424) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 00:55:00.004507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2f78014-3fc5-46ec-8d2f-13c10c602151 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:00.007466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2f78014-3fc5-46ec-8d2f-13c10c602151 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:00.008254 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2f78014-3fc5-46ec-8d2f-13c10c602151 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:00.010784 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2f78014-3fc5-46ec-8d2f-13c10c602151 None None] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:00.013303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2f78014-3fc5-46ec-8d2f-13c10c602151 None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:00.014024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2f78014-3fc5-46ec-8d2f-13c10c602151 None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:00.024024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.compute.rpcapi [None req-e2f78014-3fc5-46ec-8d2f-13c10c602151 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 02 00:55:00.035608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2f78014-3fc5-46ec-8d2f-13c10c602151 None None] Releasing lock "compute-rpcapi-router" {{(pid=120424) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 00:55:00.065793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e2f78014-3fc5-46ec-8d2f-13c10c602151 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.487673 Oct 02 00:55:00.066980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 32/53] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:00.079045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:55:00.082453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:55:00.083281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:55:00.085440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:55:00.086079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:55:00.106694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:00.107192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:00.107687 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:00.110271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:00.110765 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:00.111200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:00.151820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Getting quotas for project ff4aef28dfc444ee914b56c64b2edb77. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:55:00.159873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Getting quotas for user a8894fd1044241ee8ba84927b6e8326a and project ff4aef28dfc444ee914b56c64b2edb77. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:55:00.191047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:55:00.193785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:55:00.299807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bb01f74-0587-4621-804b-06a538d918df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.603784 Oct 02 00:55:00.306297 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 22/54] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Oct 2 00:54:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 4612 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 02 00:55:00.313038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7e45c6db-b96b-48a5-9453-e62c66dc92f7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:00.314497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7e45c6db-b96b-48a5-9453-e62c66dc92f7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:00.328793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:00.329428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:00.358406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:00.366343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:00.367138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:00.368933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:00.372101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:00.373250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:00.459645 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7e45c6db-b96b-48a5-9453-e62c66dc92f7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:00.477379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7e45c6db-b96b-48a5-9453-e62c66dc92f7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:00.481585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7e45c6db-b96b-48a5-9453-e62c66dc92f7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:00.487343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7e45c6db-b96b-48a5-9453-e62c66dc92f7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1281 microversion: 2.20 time: 0.178690 Oct 02 00:55:00.490627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 33/55] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:00 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:00.610476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:00.611095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:00.636426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:00.649015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:00.656411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:00.657369 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:00.663942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:00.668257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:00.760756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:00.770045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79866e64-09e9-4068-b196-7335c5b4e3b1 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.445707 Oct 02 00:55:00.775046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 23/56] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:00 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:55:00.907556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:00.921969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a3a57e8c-af97-4976-b2da-b9936f47330d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1279 microversion: 2.1 time: 0.316573 Oct 02 00:55:00.938980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 34/57] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:00 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:01.535820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:01.536761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:01.560276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:01.562807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:01.563364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:01.564375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:01.564916 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:01.565377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:01.810641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:01.812746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:01.826780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:01.829740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:01.830438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:01.835270 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:01.837961 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:01.838664 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:01.962456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:01.980153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:02.002748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:02.007152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-021ac116-46ac-4b9e-9729-0e647e05f39e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1285 microversion: 2.20 time: 0.487903 Oct 02 00:55:02.010972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 24/58] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:01 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1285 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:02.018721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:02.024532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:02.038517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:02.039171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:02.042241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:02.043180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:02.043889 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:02.048204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:02.978042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:02.998380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-524e5e6c-bfb2-4779-9658-8920c69e8ec2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 1.192746 Oct 02 00:55:03.000942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 35/59] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:01 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:03.043361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:03.043976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:03.056351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:03.056848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:03.057352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:03.058082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:03.058532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:03.058952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:03.238592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:03.244132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:03.249173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:03.253888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce60c31e-b20f-48d0-a16a-43dd10642ae8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 1.241590 Oct 02 00:55:03.256695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:03.257837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a70a4d42-4f22-498f-ae1f-388619bb0669 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1333 microversion: 2.20 time: 0.219163 Oct 02 00:55:03.258428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 36/60] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:03 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1333 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:03.283261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 25/61] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:02 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:04.038461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:04.039220 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:04.059129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:04.059747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:04.060196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:04.060914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:04.061363 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:04.064828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:04.289169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:04.289958 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:04.303127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:04.303623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:04.304059 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:04.304767 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:04.305222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:04.305643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:04.546513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:04.568566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:04.583244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:04.599195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c77e4eee-2466-4017-8e7e-48c3b8cd33a4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1333 microversion: 2.20 time: 0.313947 Oct 02 00:55:04.612361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 26/62] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:04 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1333 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:04.623390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:04.624369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:04.631918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:04.632800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:04.633807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:04.635323 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:04.636134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:04.636930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:04.644258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:04.663946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9209133d-6d14-475c-ab91-cfd469a241a0 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.640430 Oct 02 00:55:04.665318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 37/63] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:04 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:05.304367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-842ad0be-843f-43e1-83d4-511e312e582d req-efb9b6ff-2730-423e-ae29-9ceffe17f95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2912ff7b-f2a1-4be8-9c41-587be40143a4", "tag": "afb680fd-62c7-44e9-af54-116ec99eda55"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:05.344750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-842ad0be-843f-43e1-83d4-511e312e582d req-efb9b6ff-2730-423e-ae29-9ceffe17f95f service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:05.345544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-842ad0be-843f-43e1-83d4-511e312e582d req-efb9b6ff-2730-423e-ae29-9ceffe17f95f service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:05.348812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-842ad0be-843f-43e1-83d4-511e312e582d req-efb9b6ff-2730-423e-ae29-9ceffe17f95f service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:05.349832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:05.374241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f953519e-7ece-41ac-a325-3111e46d49d3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.760677 Oct 02 00:55:05.375097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 27/64] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:04 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:05.381694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-842ad0be-843f-43e1-83d4-511e312e582d req-efb9b6ff-2730-423e-ae29-9ceffe17f95f service nova] Creating event network-changed:afb680fd-62c7-44e9-af54-116ec99eda55 for instance 2912ff7b-f2a1-4be8-9c41-587be40143a4 on hv-cinder-maste Oct 02 00:55:05.388144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-842ad0be-843f-43e1-83d4-511e312e582d req-efb9b6ff-2730-423e-ae29-9ceffe17f95f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092745 Oct 02 00:55:05.388729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 38/65] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:05.633475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:05.634433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:05.644627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:05.646139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:05.647281 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:05.648979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:05.650406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:05.651832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:05.661862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-48a52a8c-c817-43dd-851a-63b14996f43d req-7d37cc5c-9d88-4422-80d7-0260af4ac090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6686edd9-ff59-4ebd-9253-f49114e9a954", "tag": "41507aba-ced8-48a1-9f84-c484c0fd1778"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:05.686554 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48a52a8c-c817-43dd-851a-63b14996f43d req-7d37cc5c-9d88-4422-80d7-0260af4ac090 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:05.688271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48a52a8c-c817-43dd-851a-63b14996f43d req-7d37cc5c-9d88-4422-80d7-0260af4ac090 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:05.689084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48a52a8c-c817-43dd-851a-63b14996f43d req-7d37cc5c-9d88-4422-80d7-0260af4ac090 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:05.718476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-48a52a8c-c817-43dd-851a-63b14996f43d req-7d37cc5c-9d88-4422-80d7-0260af4ac090 service nova] Creating event network-changed:41507aba-ced8-48a1-9f84-c484c0fd1778 for instance 6686edd9-ff59-4ebd-9253-f49114e9a954 on hv-cinder-maste Oct 02 00:55:05.719265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48a52a8c-c817-43dd-851a-63b14996f43d req-7d37cc5c-9d88-4422-80d7-0260af4ac090 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 02 00:55:05.719851 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48a52a8c-c817-43dd-851a-63b14996f43d req-7d37cc5c-9d88-4422-80d7-0260af4ac090 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 02 00:55:05.721118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b4b65a4-48cc-4a78-839f-7a82ecbb262e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:05.721932 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b4b65a4-48cc-4a78-839f-7a82ecbb262e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:05.722576 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b4b65a4-48cc-4a78-839f-7a82ecbb262e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:05.724017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b4b65a4-48cc-4a78-839f-7a82ecbb262e None None] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:05.724672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b4b65a4-48cc-4a78-839f-7a82ecbb262e None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:05.725332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b4b65a4-48cc-4a78-839f-7a82ecbb262e None None] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:05.755348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.compute.rpcapi [None req-1b4b65a4-48cc-4a78-839f-7a82ecbb262e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 02 00:55:05.761760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b4b65a4-48cc-4a78-839f-7a82ecbb262e None None] Releasing lock "compute-rpcapi-router" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 02 00:55:05.791141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b4b65a4-48cc-4a78-839f-7a82ecbb262e None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.414112 Oct 02 00:55:05.792405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 28/66] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:05.798703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:05.803633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:05.815091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:05.822994 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:05.826605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:05.827191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:05.828026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:05.828599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:05.829134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:05.837785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:05.840302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:05.843351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-26e52f7f-4de9-45b4-afdf-c3073898af5a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1339 microversion: 2.20 time: 0.218338 Oct 02 00:55:05.848251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 39/67] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:05 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:06.191227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:06.202586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d23c8e90-28fe-4ef3-aa11-27db3717ea78 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.408512 Oct 02 00:55:06.203371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 29/68] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:05 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:06.398821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:06.400060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:06.413923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:06.413923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:06.413923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:06.414999 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:06.415667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:06.416296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:06.671605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:06.690831 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-30c24a70-8e93-4995-a744-1d0d2e0a3c32 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.296375 Oct 02 00:55:06.698117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 40/69] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:06 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:06.877775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:06.880498 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:06.888572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:06.890146 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:06.890774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:06.891779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:06.892403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:06.892839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:07.148129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:07.160898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:07.162721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:07.165891 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9731353c-dfb6-440d-8cac-72487517f3d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.294219 Oct 02 00:55:07.167100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 30/70] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:06 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:07.226182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:07.226779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:07.236920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:07.237460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:07.237899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:07.238692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:07.239119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:07.239541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:07.643757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:07.655407 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f3ad6f22-3eeb-4227-8c39-25e509dbee92 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.433203 Oct 02 00:55:07.662693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 41/71] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:07 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:07.719298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:07.720591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:07.744862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:07.745371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:07.745809 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:07.746800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:07.748371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:07.750138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:08.191137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:08.192695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:08.207114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:08.207682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:08.208120 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:08.208920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:08.209273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:08.209693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:08.286693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:08.299386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3045b10e-837b-4304-97de-8ca7746659f6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.590074 Oct 02 00:55:08.300941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 31/72] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:07 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:08.509954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:08.527473 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:08.530308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:08.533040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a0737c77-fa8a-4f15-9360-68199877926b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.345736 Oct 02 00:55:08.534713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 42/73] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:08 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:08.685684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:08.686753 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:08.701201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:08.702725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:08.704853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:08.707042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:08.708451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:08.709597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:09.041140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:09.051026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80b82662-1d99-4d34-9493-66c53f58e0e2 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.369472 Oct 02 00:55:09.052153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 32/74] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:08 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:09.141806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-d7ca848e-6999-484e-b614-a8c9714a118d req-faa491c5-63f7-4bfe-83b0-e9eb1fb1e75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c4241ee-1589-42f2-986e-abe5f0a2c369", "tag": "bb0e6fe9-481b-4e10-995c-f5411611262d"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:09.156670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-d7ca848e-6999-484e-b614-a8c9714a118d req-faa491c5-63f7-4bfe-83b0-e9eb1fb1e75e service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:09.157430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-d7ca848e-6999-484e-b614-a8c9714a118d req-faa491c5-63f7-4bfe-83b0-e9eb1fb1e75e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:09.158034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-d7ca848e-6999-484e-b614-a8c9714a118d req-faa491c5-63f7-4bfe-83b0-e9eb1fb1e75e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:09.172459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-d7ca848e-6999-484e-b614-a8c9714a118d req-faa491c5-63f7-4bfe-83b0-e9eb1fb1e75e service nova] Creating event network-changed:bb0e6fe9-481b-4e10-995c-f5411611262d for instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 on hv-cinder-maste Oct 02 00:55:09.178360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-d7ca848e-6999-484e-b614-a8c9714a118d req-faa491c5-63f7-4bfe-83b0-e9eb1fb1e75e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041143 Oct 02 00:55:09.179487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 43/75] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:09.325592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:09.327096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:09.340077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:09.341974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:09.342618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:09.344848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:09.345704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:09.349460 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:09.566299 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:09.567423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:09.579980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:09.580468 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:09.580937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:09.583356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:09.583819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:09.584249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:09.589536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:09.601001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f96085c-ea61-4707-84c5-2a59784226ab tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.281779 Oct 02 00:55:09.607215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 33/76] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:09 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:09.784603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:09.796445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:09.805409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:09.807179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e38aab07-7eca-443e-a932-fe7d1dc37b99 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.249015 Oct 02 00:55:09.808912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 44/77] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:09 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:10.079601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:10.080294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:10.087512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:10.088254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:10.088691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:10.089795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:10.090577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:10.091277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:10.183933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=16 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:10.333495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:10.342848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93a375f5-1de5-4580-a678-df1157018e4b tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.267946 Oct 02 00:55:10.364499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 34/78] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:10 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:10.625743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:10.626408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:10.628619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:10.629334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=22 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:10.637937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:10.646042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:10.646521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:10.647246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:10.647704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:10.648132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:10.857918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:10.862295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:10.893705 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:10.897005 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:10.900736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:10.910187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d7c08826-126e-46ba-8793-b8ada1999f07 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.288817 Oct 02 00:55:10.911881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:10.913795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:10.914257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 45/79] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:10 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:10.915096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:10.916215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:10.968322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:11.200900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:11.222260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:11.229350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:11.232972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0cb31708-2199-460d-91f8-a99679022a36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.396236 Oct 02 00:55:11.234405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 35/80] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:10 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:11.373234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:11.374047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:11.385967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:11.388523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:11.389171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:11.390877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:11.391684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:11.393846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:11.713911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:11.723515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c0ea0a63-cba8-4184-811c-a47dd361bfc3 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.354442 Oct 02 00:55:11.726836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 46/81] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:11 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:11.953838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:11.954812 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:11.963859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:11.965399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:11.966772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:11.967763 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:11.968417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:11.969361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:12.130702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:12.138845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-17b5a7ad-9fd2-490d-9d28-e1d1f5cfbefb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.189682 Oct 02 00:55:12.139941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 36/82] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:11 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:12.289358 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:12.291000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:12.298234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:12.298234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:12.298493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:12.299159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:12.299557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:12.299976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:12.317916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:12.446176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:12.458501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:12.460133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:12.461247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c3d206ed-4dc6-4aed-8e6a-6e775dc44a0b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.177816 Oct 02 00:55:12.461800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 47/83] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:12 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:12.763566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:12.764347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:12.772364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:12.772938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:12.773716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:12.774631 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:12.775244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:12.775676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:12.923831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:12.933155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c98fc6cb-6ca5-43df-bcc7-6e2d9effc5d7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.174119 Oct 02 00:55:12.933661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 37/84] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:12 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:13.164131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:13.164804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:13.167671 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:13.177660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:13.178179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:13.178622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:13.179329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:13.179788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:13.180208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:13.365381 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:13.374305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6ce3fdc6-ecd4-44f3-b446-8386e6cfdeb9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.214682 Oct 02 00:55:13.375395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 48/85] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:13 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:13.486950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:13.487639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:13.494707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:13.495287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:13.495788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:13.496947 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:13.497487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:13.497991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:13.631181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:13.640884 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:13.642457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:13.643568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf372da3-d36b-4c85-8353-bb6d72abf065 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.162095 Oct 02 00:55:13.644181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 38/86] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:13 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:13.955472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:13.956083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:13.962019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:13.962745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:13.963114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:13.963800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:13.964407 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:13.964830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:14.109137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:14.119827 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aa423469-ba1b-414d-890d-ed39fba79d3d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.167855 Oct 02 00:55:14.120631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 49/87] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:13 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:14.397066 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:14.397709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:14.399585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:14.404777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:14.405262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:14.405701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:14.406418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:14.406873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:14.407354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:14.543454 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:14.555510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-acb5f3a4-518f-48fe-ad37-5e1405d8a729 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.162815 Oct 02 00:55:14.556081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 39/88] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:14 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:14.668481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:14.669254 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:14.675374 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:14.675853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:14.676280 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:14.676963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:14.677576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:14.678112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:14.810978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:14.819639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:14.821168 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:14.822175 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-51363c69-cecb-4b69-9d82-95c5a184eb43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.157805 Oct 02 00:55:14.822990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 50/89] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:14 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:15.147626 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:15.148546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:15.154951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:15.155440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:15.155879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:15.156575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:15.157031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:15.157458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:15.323058 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:15.331143 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-88edf825-4537-4aed-9bdb-f3da532558e8 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.191602 Oct 02 00:55:15.331921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 40/90] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:15 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:15.577800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:15.578432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:15.584911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:15.585387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:15.585814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:15.586528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:15.586977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:15.587398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:15.715028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:15.723050 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-67ebd094-2175-43c7-a54c-d067de74a783 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.148944 Oct 02 00:55:15.723610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 51/91] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:15 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:15.848823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:15.849326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:15.851194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:15.856585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:15.857056 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:15.857484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:15.858197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:15.858676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:15.859093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:15.984864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:15.993381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:15.994841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:15.995925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9917bd2-20e0-4e26-9fcd-391b9a40e1af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.151072 Oct 02 00:55:15.996737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 41/92] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:15 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:16.354632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:16.355673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:16.366484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:16.366976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:16.367416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:16.368106 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:16.368560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:16.368983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:16.492723 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:16.500586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f40f23cd-5609-4a9c-b15e-c05ccf356137 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.149697 Oct 02 00:55:16.501149 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 52/93] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:16 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:16.744725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:16.745363 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:16.751496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:16.751967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:16.752395 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:16.753071 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:16.753518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:16.753934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:16.880574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:16.888103 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-630dbd26-18f1-4342-a7ec-a9f7ee4d62a5 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.147304 Oct 02 00:55:16.888655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 42/94] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:16 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:17.021620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:17.022262 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:17.028196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:17.028681 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:17.029114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:17.029803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:17.030285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:17.030709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:17.163247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:17.171320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:17.172767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:17.173861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c32793dd-583d-4987-b44d-47a80f8aa530 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.156670 Oct 02 00:55:17.174450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 53/95] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:17 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:17.523682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:17.524352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:17.530260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:17.530743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:17.531174 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:17.531861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:17.532313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:17.532735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:17.695705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:17.703974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-955ffcf7-65e7-48e7-bb67-526d245927b7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.185996 Oct 02 00:55:17.706436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 43/96] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:17 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:17.920416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:17.921104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:17.944408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:17.944913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:17.945356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:17.952179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:17.954382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:17.954913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:18.199804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:18.201055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:18.210758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:18.213599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:18.215054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:18.219585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:18.220298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:18.222580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:18.857666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:18.872757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ae4fe85a-f0b8-4552-84cb-ea0cb5094956 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.963130 Oct 02 00:55:18.874015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 54/97] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:17 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:18.968418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-c7600bc0-7b5a-4a30-8153-3fb7d964aa47 req-6ee3e2b0-b3b2-42a6-b40c-1de373a600c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd2929d-fbbf-498d-881f-142ede942767", "name": "network-vif-plugged", "status": "completed", "tag": "f0316a21-607f-46f6-b48c-57949a51bc86"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:18.982608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-c7600bc0-7b5a-4a30-8153-3fb7d964aa47 req-6ee3e2b0-b3b2-42a6-b40c-1de373a600c1 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:18.983089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-c7600bc0-7b5a-4a30-8153-3fb7d964aa47 req-6ee3e2b0-b3b2-42a6-b40c-1de373a600c1 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:18.984735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-c7600bc0-7b5a-4a30-8153-3fb7d964aa47 req-6ee3e2b0-b3b2-42a6-b40c-1de373a600c1 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:18.999521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-c7600bc0-7b5a-4a30-8153-3fb7d964aa47 req-6ee3e2b0-b3b2-42a6-b40c-1de373a600c1 service nova] Creating event network-vif-plugged:f0316a21-607f-46f6-b48c-57949a51bc86 for instance abd2929d-fbbf-498d-881f-142ede942767 on hv-cinder-maste Oct 02 00:55:19.019355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-c7600bc0-7b5a-4a30-8153-3fb7d964aa47 req-6ee3e2b0-b3b2-42a6-b40c-1de373a600c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143205 Oct 02 00:55:19.022512 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 55/98] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:19.022817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:19.028980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:19.029936 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:19.030043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:19.031486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:19.032592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf9d8f8c-7d66-429d-8404-1def64c8c9bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.837274 Oct 02 00:55:19.033141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 44/99] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:18 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:19.037789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:19.038418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:19.039291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:19.043395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:19.043878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:19.044588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:19.228900 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:19.236750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fa409d89-5b6d-423c-9478-3b6058132a95 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.212483 Oct 02 00:55:19.237308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 56/100] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:19 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:19.900682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:19.901361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:19.907300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:19.907869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:19.908295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:19.908976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:19.909423 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:19.909843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:20.044274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:20.054678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26ef937c-e151-483a-ba9b-0dc184d8b205 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.158053 Oct 02 00:55:20.055602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 45/101] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:19 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:20.067657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:20.068396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:20.074958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:20.076085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:20.076683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:20.077561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:20.078388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:20.078973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:20.232756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:20.241936 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:20.243408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:20.244603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8a2ed82f-8f06-477a-9604-319c7c6ec3bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.181242 Oct 02 00:55:20.245160 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 57/102] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:20 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:20.265020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:20.266097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:20.272772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:20.273265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:20.273703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:20.274584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:20.275039 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:20.275459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:20.417618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:20.428458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-650a4076-aae5-4738-be11-4bea06d65cce tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.168839 Oct 02 00:55:20.429815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 46/103] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:20 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:21.078868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:21.079724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:21.087005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:21.087617 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:21.088114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:21.089039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:21.089845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:21.090382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:21.238190 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:21.246348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0b41dbee-1498-452d-9ab7-5ae31b1760fe tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.171770 Oct 02 00:55:21.246932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 58/104] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:21 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:21.270620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:21.271227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:21.277024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:21.277499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:21.277929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:21.278636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:21.279080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:21.279502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:21.407017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:21.415465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:21.416923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:21.418078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ca460e01-1eb5-44c2-89a0-f1a0c7508928 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.151824 Oct 02 00:55:21.418645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 47/105] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:21 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:21.451795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:21.452413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:21.459711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:21.460197 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:21.460635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:21.461321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:21.461790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:21.462255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:21.605406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:21.613643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-df6e80e5-88dc-47aa-9140-6986c49c18fc tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.165740 Oct 02 00:55:21.614332 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 59/106] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:21 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:22.132337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a277527d-77ee-4d4c-b424-fe865a6b0393 req-133bb465-b3a5-42c2-8302-217aaf32f416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6686edd9-ff59-4ebd-9253-f49114e9a954", "name": "network-vif-plugged", "status": "completed", "tag": "41507aba-ced8-48a1-9f84-c484c0fd1778"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:22.149150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a277527d-77ee-4d4c-b424-fe865a6b0393 req-133bb465-b3a5-42c2-8302-217aaf32f416 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:22.149806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a277527d-77ee-4d4c-b424-fe865a6b0393 req-133bb465-b3a5-42c2-8302-217aaf32f416 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:22.151470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a277527d-77ee-4d4c-b424-fe865a6b0393 req-133bb465-b3a5-42c2-8302-217aaf32f416 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:22.185592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a277527d-77ee-4d4c-b424-fe865a6b0393 req-133bb465-b3a5-42c2-8302-217aaf32f416 service nova] Creating event network-vif-plugged:41507aba-ced8-48a1-9f84-c484c0fd1778 for instance 6686edd9-ff59-4ebd-9253-f49114e9a954 on hv-cinder-maste Oct 02 00:55:22.194921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a277527d-77ee-4d4c-b424-fe865a6b0393 req-133bb465-b3a5-42c2-8302-217aaf32f416 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067680 Oct 02 00:55:22.195532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 48/107] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:22.269252 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:22.270015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:22.281757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:22.283508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:22.284154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:22.285787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:22.286588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:22.287240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:22.448093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:22.449013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:22.461700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:22.463997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:22.465033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:22.470946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:22.471823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:22.473377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:22.901307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:22.908843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:22.911699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-00e4ce13-5dab-46c3-b0b6-a3f1b671d5d0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.646639 Oct 02 00:55:22.912268 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 60/108] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:22 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:22.923922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:22.926203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:22.928202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5ead48d-bd33-4c57-80d5-24a5652e9839 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.487382 Oct 02 00:55:22.929410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 49/109] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:22 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:22.933006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:22.933272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:22.940242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:22.940887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:22.941602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:22.942494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:22.942955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:22.943380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:23.096207 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:23.105404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-83827271-9fcf-430a-9d1b-b78f31d7da1e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.191860 Oct 02 00:55:23.105974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 61/110] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:22 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:23.937572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:23.938216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:23.948093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:23.948820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:23.957942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:23.959297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:23.961506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:23.963977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:23.964615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:23.968444 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:23.976632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:23.977302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:23.979298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:23.980627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:23.981275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:23.983103 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:24.291534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:24.305264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5357647d-3012-402e-9345-3bd19042b367 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.370363 Oct 02 00:55:24.305882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 50/111] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:23 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:24.311452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:24.313216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:24.314703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:24.321711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:24.323228 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:24.324694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-010116d9-e880-4e5a-b0b7-2016003f1f95 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.373130 Oct 02 00:55:24.325247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 62/112] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:23 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:24.329939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-33682842-d8d8-4fe4-9d82-bb250df8963b req-d8f379ad-8819-417d-992b-c0e0ab46776c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2912ff7b-f2a1-4be8-9c41-587be40143a4", "name": "network-vif-plugged", "status": "completed", "tag": "afb680fd-62c7-44e9-af54-116ec99eda55"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:24.338046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:24.338624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:24.339078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:24.339933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-33682842-d8d8-4fe4-9d82-bb250df8963b req-d8f379ad-8819-417d-992b-c0e0ab46776c service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:24.340584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-33682842-d8d8-4fe4-9d82-bb250df8963b req-d8f379ad-8819-417d-992b-c0e0ab46776c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:24.341323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-33682842-d8d8-4fe4-9d82-bb250df8963b req-d8f379ad-8819-417d-992b-c0e0ab46776c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:24.345938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:24.347234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:24.348463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:24.355761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-33682842-d8d8-4fe4-9d82-bb250df8963b req-d8f379ad-8819-417d-992b-c0e0ab46776c service nova] Creating event network-vif-plugged:afb680fd-62c7-44e9-af54-116ec99eda55 for instance 2912ff7b-f2a1-4be8-9c41-587be40143a4 on hv-cinder-maste Oct 02 00:55:24.361295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-33682842-d8d8-4fe4-9d82-bb250df8963b req-d8f379ad-8819-417d-992b-c0e0ab46776c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034915 Oct 02 00:55:24.362833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 63/113] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:24.510444 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:24.521539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c06b661b-bbd6-41b4-ab62-648b0dda9ca6 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.211823 Oct 02 00:55:24.523433 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 51/114] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:24 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:25.329549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:25.330318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:25.337279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:25.337993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:25.338640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:25.339540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:25.339996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:25.340423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:25.356628 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:25.357477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:25.365545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:25.366541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:25.367192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:25.367940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:25.368683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:25.369159 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:25.390728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:25.536849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:25.545009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ad6ebaca-4952-4bd2-8c54-b18e4ea0ea42 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.219758 Oct 02 00:55:25.559989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:25.560464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 64/115] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:25 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:55:25.566018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:25.566814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:25.570284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:25.572361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:25.572626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:25.573103 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:25.573533 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:25.573634 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27a819e6-153b-4aa7-a1ed-2d6d672e1034 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.224288 Oct 02 00:55:25.574452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 52/116] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:25 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:25.574554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:25.574695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:25.575276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:25.594187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:25.707832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:25.715526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9fe78f16-829c-427b-8780-bbf0ee2c530c tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.153835 Oct 02 00:55:25.721991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 65/117] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:25 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:26.568616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:26.569376 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:26.575300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.575788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.576224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.576947 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.577399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.577824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.599579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:26.600310 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:26.607345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.608069 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.608516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.609307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.609709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.610155 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.768063 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:26.777345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d0ea70e2-e797-4f62-a421-25fefa33d1ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.213025 Oct 02 00:55:26.778209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 53/118] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:26 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:26.790620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:26.798401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:26.799111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:26.799750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:26.802428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:26.803828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-10f6e1e0-3f14-42f6-80c2-4422d5a8c14a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.208722 Oct 02 00:55:26.804464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 66/119] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:26 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:26.806255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.806746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.807172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.807864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:26.808425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:26.808845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:26.941404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:26.949568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d4ea408e-fe33-45db-ac62-8431290b4f15 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.157600 Oct 02 00:55:26.950470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 54/120] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:26 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:27.805634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:27.806331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:27.819695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:27.820226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:27.820704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:27.821595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:27.824254 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:27.824862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:27.832006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:27.832766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:27.842542 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:27.844895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:27.845289 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:27.846191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:27.846785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:27.847556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:28.134141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:28.154271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:28.156342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:28.158020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f5363fec-6c42-475f-a533-e445c06420db tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.333796 Oct 02 00:55:28.159101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 55/121] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:27 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:28.162085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:28.166110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:28.166896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:28.173196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:28.173673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:28.174147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:28.175056 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:28.175676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:28.176362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:28.182349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b4bfd642-5ebd-4322-9785-eb0b6309ed9d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.380588 Oct 02 00:55:28.190091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 67/122] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:27 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:28.340358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:28.348530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8003c478-d19c-4f65-b88e-d390534b82cb tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1315 microversion: 2.1 time: 0.188203 Oct 02 00:55:28.349087 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 56/123] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:28 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:29.183624 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:29.184540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:29.190870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:29.191382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:29.191970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:29.192684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:29.193124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:29.193545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:29.207848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:29.208460 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:29.216483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:29.216971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:29.217400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:29.218330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:29.221740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:29.224234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:29.467785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:29.480371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:29.485762 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:29.488345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:29.494551 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2a7be783-eb12-4565-94ac-866a83a31e42 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.307852 Oct 02 00:55:29.495187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 68/124] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:29 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:29.500540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:29.501151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:29.512008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40325ec8-6925-4461-b561-fd2165a38d7b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.307950 Oct 02 00:55:29.515975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:29.516640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:29.517073 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:29.517771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:29.518322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:29.518670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:29.521544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 57/125] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:29 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:55:29.530479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a085af57-fb05-42f3-a006-16b5f2ec5f85 req-a5f1a3ff-e74e-4d47-b7a3-fc64db8348d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4241ee-1589-42f2-986e-abe5f0a2c369", "name": "network-vif-plugged", "status": "completed", "tag": "bb0e6fe9-481b-4e10-995c-f5411611262d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:29.545785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a085af57-fb05-42f3-a006-16b5f2ec5f85 req-a5f1a3ff-e74e-4d47-b7a3-fc64db8348d7 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:29.546937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a085af57-fb05-42f3-a006-16b5f2ec5f85 req-a5f1a3ff-e74e-4d47-b7a3-fc64db8348d7 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:29.548238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a085af57-fb05-42f3-a006-16b5f2ec5f85 req-a5f1a3ff-e74e-4d47-b7a3-fc64db8348d7 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:29.565116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a085af57-fb05-42f3-a006-16b5f2ec5f85 req-a5f1a3ff-e74e-4d47-b7a3-fc64db8348d7 service nova] Creating event network-vif-plugged:bb0e6fe9-481b-4e10-995c-f5411611262d for instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 on hv-cinder-maste Oct 02 00:55:29.572691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a085af57-fb05-42f3-a006-16b5f2ec5f85 req-a5f1a3ff-e74e-4d47-b7a3-fc64db8348d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048244 Oct 02 00:55:29.574861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 58/126] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:29.702201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:29.713368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-571d51d5-cefb-44ea-a50d-b23e19a72e4d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1502 microversion: 2.1 time: 0.216226 Oct 02 00:55:29.714657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 69/127] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:29 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:30.520144 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:30.520919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:30.527533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:30.528064 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:30.528568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:30.529420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:30.529885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:30.530568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:30.539631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:30.540906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:30.547130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:30.547864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:30.548667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:30.549606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:30.550189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:30.551381 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:30.784004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:30.795450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:30.795859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:30.797851 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:30.799504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19963b47-510a-4ae8-8c6c-b1c742160e5e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.283596 Oct 02 00:55:30.800552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 59/128] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:30 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:30.809399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fe936710-7a93-468f-849c-0ccda405425c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.274265 Oct 02 00:55:30.810161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 70/129] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:30 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:55:31.824734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:31.825342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:31.832084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:31.832576 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:31.832804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:31.833208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:31.833402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:31.833685 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:31.834169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:31.834591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:31.839409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:31.839893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:31.840340 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:31.841642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:31.842132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:31.842561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:32.090588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:32.095958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:32.099670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:32.101304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:32.102636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-52cfc415-22d6-4a7b-84bc-dabc138c0e90 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.281772 Oct 02 00:55:32.103397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 60/130] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:31 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:32.104216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eac14e2d-4d6e-485e-b1d6-e85d27830628 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1321 microversion: 2.1 time: 0.275678 Oct 02 00:55:32.104805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 71/131] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:31 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:55:33.127142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:33.127748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:33.134882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:33.136225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:33.146621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:33.147109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:33.147532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:33.148231 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:33.148690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:33.149110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:33.154855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:33.155350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:33.155786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:33.156485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:33.156939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:33.157358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:33.379241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:33.390976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1f91be50-8805-46db-a787-3a4bd81e635f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1516 microversion: 2.1 time: 0.267629 Oct 02 00:55:33.391899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:33.392087 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 61/132] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:33 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:55:33.400879 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:33.402455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:33.404794 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f21d4d91-e3aa-484b-95b1-7bf0fbfab1d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.272494 Oct 02 00:55:33.412026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 72/133] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:33 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:33.418175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:33.420548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:33.427349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:33.427840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:33.428267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:33.428957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:33.429405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:33.429823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:33.493614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lazy-loading 'flavor' on Instance uuid 2912ff7b-f2a1-4be8-9c41-587be40143a4 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:55:33.621598 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2689706-360d-46ed-89f4-56929f26e61b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4/action" status: 200 len: 32 microversion: 2.1 time: 0.208426 Oct 02 00:55:33.622244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 62/134] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:55:33 2022] POST /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:55:33.632234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:33.632968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:33.638944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:33.639423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:33.639852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:33.640533 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:33.640984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:33.641484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:33.773500 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:33.781138 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-144e4426-aeaf-468f-8a9d-63c6c4944939 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.153311 Oct 02 00:55:33.781702 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 73/135] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:33 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:55:34.432858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:34.433564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:34.440189 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:34.440715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:34.441228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:34.441941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:34.442427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:34.449714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:34.573042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:34.581104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:34.583177 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:34.584332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-613c31fb-9c05-4950-bdce-8e0738282119 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.157562 Oct 02 00:55:34.584882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 63/136] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:34 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:34.803565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:34.804242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:34.810251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:34.810735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:34.811171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:34.811886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:34.812343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:34.812769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:34.940718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:34.948353 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-984c8fb5-85f2-4c18-a45e-9b7bb7f35552 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.148689 Oct 02 00:55:34.949105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 74/137] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:34 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:35.609762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:35.610331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:35.616185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:35.616667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:35.617099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:35.617782 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:35.618273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:35.618698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:35.742052 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:35.750392 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:35.751828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:35.752939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cfe53c08-89ac-4f52-a4bc-d6c4e9fcd1a1 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.147048 Oct 02 00:55:35.754051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 64/138] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:35 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:35.971389 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:35.972450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:35.978472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:35.978960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:35.979398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:35.980088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:35.980544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:35.980971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:36.130318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:36.139501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f1f8d100-38a0-4223-adc9-a55043915d4c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.172032 Oct 02 00:55:36.140683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 75/139] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:35 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:36.537675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cb98099-518e-41e2-afa3-ae331139a86e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d334c7d-c6ff-4a39-b5e5-5abd0af8f698"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:36.540026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8cb98099-518e-41e2-afa3-ae331139a86e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:36.546788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb98099-518e-41e2-afa3-ae331139a86e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:36.547459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb98099-518e-41e2-afa3-ae331139a86e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:36.548412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb98099-518e-41e2-afa3-ae331139a86e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:36.549116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb98099-518e-41e2-afa3-ae331139a86e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:36.549570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb98099-518e-41e2-afa3-ae331139a86e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:36.550609 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb98099-518e-41e2-afa3-ae331139a86e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:36.779296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:36.779902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:36.786604 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:36.787194 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:36.787755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:36.788556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:36.789082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:36.789575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:36.931459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:36.940130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:36.942654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:36.943972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f7cd6804-aa49-4029-a623-ef2767cced3c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.168710 Oct 02 00:55:36.954751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 76/140] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:36 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:37.165344 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:37.165954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:37.172064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:37.176094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:37.176993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:37.178522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:37.179797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:37.180736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:37.360972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:37.372987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c913dc48-2798-4fe0-a5d5-5c4be7a3e781 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.212429 Oct 02 00:55:37.373595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 77/141] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:37 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:37.714747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cb98099-518e-41e2-afa3-ae331139a86e tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "POST /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.182804 Oct 02 00:55:37.715570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 65/142] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 00:55:36 2022] POST /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767/os-volume_attachments => generated 194 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:37.970429 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:37.971378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:37.979823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:37.980667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:37.980980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:37.981672 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:37.982140 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:37.982772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:38.197371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:38.207111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:38.208707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:38.209949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4ec08581-604c-4aa6-b386-77bcca9a774e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.244345 Oct 02 00:55:38.211177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 78/143] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:37 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:55:38.398743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:38.399528 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:38.411651 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:38.412075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:38.412713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:38.413570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:38.414254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:38.414678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:38.446852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:38.626419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:38.634500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1ac1a13-681f-4417-93f8-c0c0eca12101 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.240676 Oct 02 00:55:38.634500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 66/144] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:38 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:39.245819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:39.247750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:39.261463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:39.261966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:39.262432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:39.263140 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:39.263726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:39.264302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:39.519507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:39.536829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:39.538745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:39.540570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c79aef3c-8509-45c6-ac83-4710bc668f86 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.308214 Oct 02 00:55:39.541496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 79/145] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:39 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:39.671439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:39.672055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:39.684882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:39.685369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:39.685798 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:39.690418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:39.690948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:39.691391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:39.912509 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:39.933127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be621ad4-d7af-4278-aa64-959654f2e3b4 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.265972 Oct 02 00:55:39.933966 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 67/146] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:39 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:40.570543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:40.571774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:40.579445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:40.580151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:40.580735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:40.582731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:40.583339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:40.584098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:40.756989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:40.770913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:40.774903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:40.776157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aa73895c-e2be-4898-a86f-6c09527108bb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1407 microversion: 2.20 time: 0.210465 Oct 02 00:55:40.776705 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 80/147] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:40 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:40.958383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:40.959008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:40.976641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:40.977134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:40.978997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:40.983592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:40.984820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:40.991302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:41.174673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:41.184945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3283e826-be54-4f4c-b7f2-2bb93f817083 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.230406 Oct 02 00:55:41.185519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 68/148] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:40 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:41.808328 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:41.809745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:41.819103 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:41.819699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:41.820418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:41.821221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:41.821863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:41.822419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:42.017917 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:42.043359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:42.049377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:42.051435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8856ff7a-1695-4d27-96d1-0225fec222f2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1599 microversion: 2.20 time: 0.249726 Oct 02 00:55:42.052001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 81/149] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:55:41 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1599 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:55:42.077338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6125b4b3-9f21-4ec2-8440-6d9787066d21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:42.078370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6125b4b3-9f21-4ec2-8440-6d9787066d21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:42.085313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6125b4b3-9f21-4ec2-8440-6d9787066d21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:42.085971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6125b4b3-9f21-4ec2-8440-6d9787066d21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:42.086733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6125b4b3-9f21-4ec2-8440-6d9787066d21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:42.087898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6125b4b3-9f21-4ec2-8440-6d9787066d21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:42.088507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6125b4b3-9f21-4ec2-8440-6d9787066d21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:42.089084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6125b4b3-9f21-4ec2-8440-6d9787066d21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:42.216540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:42.217226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:42.227457 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:42.228258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:42.232012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:42.233279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:42.234997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:42.236301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:42.279564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:42.508312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6125b4b3-9f21-4ec2-8440-6d9787066d21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.435074 Oct 02 00:55:42.508955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 69/150] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Oct 2 00:55:42 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-interface => generated 284 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:55:42.615150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:42.624542 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-99901466-cad6-494e-ae71-79d06e7e76ef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.412809 Oct 02 00:55:42.638463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 82/151] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:42 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:43.648679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:43.649500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:43.664451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:43.666407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:43.667100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:43.669660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:43.670838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:43.671972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:44.081936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:44.093942 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8627cd66-9b60-4e32-8189-8d8915944df2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.450244 Oct 02 00:55:44.097678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 70/152] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:43 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:44.672147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-fcb5b901-7f8f-475c-83b4-b81c8176ea11 req-29220bc4-ae60-4b61-a8d8-d85ba9cb04a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c4241ee-1589-42f2-986e-abe5f0a2c369", "tag": "bb0e6fe9-481b-4e10-995c-f5411611262d"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:44.678848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=70 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:44.694865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-fcb5b901-7f8f-475c-83b4-b81c8176ea11 req-29220bc4-ae60-4b61-a8d8-d85ba9cb04a6 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:44.695759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-fcb5b901-7f8f-475c-83b4-b81c8176ea11 req-29220bc4-ae60-4b61-a8d8-d85ba9cb04a6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:44.696528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-fcb5b901-7f8f-475c-83b4-b81c8176ea11 req-29220bc4-ae60-4b61-a8d8-d85ba9cb04a6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:44.719418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-fcb5b901-7f8f-475c-83b4-b81c8176ea11 req-29220bc4-ae60-4b61-a8d8-d85ba9cb04a6 service nova] Creating event network-changed:bb0e6fe9-481b-4e10-995c-f5411611262d for instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 on hv-cinder-maste Oct 02 00:55:44.730430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-fcb5b901-7f8f-475c-83b4-b81c8176ea11 req-29220bc4-ae60-4b61-a8d8-d85ba9cb04a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062292 Oct 02 00:55:44.737040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 83/153] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:45.120320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:45.122238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:45.129583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=64 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:55:45.131442 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:45.132156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:45.132834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:45.133791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:45.134542 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:45.135180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:45.368702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:45.380144 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7128f7dc-0fa0-4e28-9216-a67ff7f44c8c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.264833 Oct 02 00:55:45.381035 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 71/154] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:45 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:46.405466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:46.406738 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:46.413419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:46.413898 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:46.414356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:46.415035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:46.415487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:46.415909 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:46.555212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:46.566086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a186996c-1e2d-4b79-a9e7-3d8e68bf732c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.164814 Oct 02 00:55:46.566737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 84/155] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:46 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:47.590537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:47.591140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:47.598204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:47.598687 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:47.599116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:47.599799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:47.600245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:47.600660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:47.835744 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:47.843432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d458be88-19a8-4035-ab35-b55aa14bccba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.256685 Oct 02 00:55:47.843993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 72/156] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:47 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:48.867064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:48.867906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:48.875330 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:48.876043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:48.876468 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:48.877350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:48.877886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:48.878536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:49.070941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:49.070941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f0990bca-da73-430d-bde4-ffb3ba35d944 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.207310 Oct 02 00:55:49.077757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 85/157] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:48 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:50.096048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:50.097699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:50.104938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:50.105432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:50.105918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:50.106777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:50.107401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:50.107906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:50.239449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:50.247823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de01a256-906c-45cb-a694-ed67bea21efb tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.156631 Oct 02 00:55:50.248383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 73/158] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:50 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:51.272066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:51.273203 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:51.281204 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:51.282278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:51.286124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:51.288736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:51.289422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:51.290280 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:51.462177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:51.472977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-488d486a-3db7-4c05-9243-141b6918d3e0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.205582 Oct 02 00:55:51.473742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 86/159] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:51 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:55:52.511894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:52.512515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:52.523053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:52.523544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:52.524168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:52.524879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:52.525502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:52.525929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:52.681208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:52.691257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a543a08-7a87-4ce0-a75a-df9885879fb8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.198028 Oct 02 00:55:52.692067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 74/160] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:52 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:53.420451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:53.420964 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:53.429119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:53.429642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:53.430205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:53.431240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:53.432063 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:53.433337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:53.485921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:55:53.643113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-01337a64-1906-4612-a690-dd024ba79ec7 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "DELETE /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 204 len: 0 microversion: 2.1 time: 0.227056 Oct 02 00:55:53.643892 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 87/161] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 00:55:53 2022] DELETE /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:55:53.656456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:53.657125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:53.667302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:53.667794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:53.668231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:53.668933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:53.669648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:53.670099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:53.718982 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:53.720223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:53.729162 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:53.729656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:53.731373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:53.732969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:53.733434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:53.736064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:53.889068 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:53.898303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93fb1621-e5cb-46f0-a0b6-7310f26fa920 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1554 microversion: 2.1 time: 0.246562 Oct 02 00:55:53.898825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 75/162] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:53 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:53.970650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:53.979472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-97648216-582f-410c-8753-a6793ec243f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.265165 Oct 02 00:55:53.980044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 88/163] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:53 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:55:54.924881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:54.926303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:54.933901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:54.934593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:54.935025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:54.935875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:54.936486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:54.936907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:55.003519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:55.004844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:55.013919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:55.014446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:55.014883 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:55.015583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:55.016034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:55.023402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:55.194880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:55.206551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3cf024c-7569-46e9-85e5-f0b27d149881 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1554 microversion: 2.1 time: 0.287332 Oct 02 00:55:55.209374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 76/164] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:54 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1554 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:55.231726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:55.241999 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-21814d3a-502e-43ed-87bd-805a26a7310a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.242814 Oct 02 00:55:55.248437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 89/165] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:54 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:56.237290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:56.238137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:56.251290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:56.255373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:56.255861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:56.256602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:56.258341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:56.260287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:56.274896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:56.275832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:56.285015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:56.285651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:56.286368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:56.287764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:56.288277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:56.289258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:56.882816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:56.896830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:56.906772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-36b9a23f-7395-4663-8fa5-31e02873f9e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.639401 Oct 02 00:55:56.907598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 90/166] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:56 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:56.910301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8dbaaa14-81e3-4eb8-ab49-8f1dba284088 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1554 microversion: 2.1 time: 0.678460 Oct 02 00:55:56.910955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 77/167] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:56 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1554 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:57.269069 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-990c7e80-2c8c-41fd-8831-b502bb63357f req-a9208b90-9334-41de-890f-d35a5af1eb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd2929d-fbbf-498d-881f-142ede942767", "name": "network-vif-deleted", "tag": "f0316a21-607f-46f6-b48c-57949a51bc86"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:55:57.299537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-990c7e80-2c8c-41fd-8831-b502bb63357f req-a9208b90-9334-41de-890f-d35a5af1eb54 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:57.300971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-990c7e80-2c8c-41fd-8831-b502bb63357f req-a9208b90-9334-41de-890f-d35a5af1eb54 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:57.301704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-990c7e80-2c8c-41fd-8831-b502bb63357f req-a9208b90-9334-41de-890f-d35a5af1eb54 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:57.323364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-990c7e80-2c8c-41fd-8831-b502bb63357f req-a9208b90-9334-41de-890f-d35a5af1eb54 service nova] Creating event network-vif-deleted:f0316a21-607f-46f6-b48c-57949a51bc86 for instance abd2929d-fbbf-498d-881f-142ede942767 on hv-cinder-maste Oct 02 00:55:57.343205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-990c7e80-2c8c-41fd-8831-b502bb63357f req-a9208b90-9334-41de-890f-d35a5af1eb54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078979 Oct 02 00:55:57.347592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 91/168] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:55:57.934767 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:57.935401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:57.942023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:57.943124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:57.951697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:57.952200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:57.952642 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:57.953354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:57.963990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:57.964464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:57.976923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:57.977801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:57.984694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:57.988507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:57.989692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:57.990643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:58.084575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:58.085080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:58.085525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:58.086048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lazy-loading 'fault' on Instance uuid abd2929d-fbbf-498d-881f-142ede942767 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:55:58.255462 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee548b86b214493e83a00964137c4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e983e7eb1474850a440d1e022c7c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:58.265109 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f4f4c75-174b-4331-bb30-ecb959ac792d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 200 len: 1351 microversion: 2.1 time: 0.335240 Oct 02 00:55:58.284045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 78/169] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:57 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 1351 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:58.388641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:58.407295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-23158da0-71b3-4ed5-842d-53a9cc44bfcd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.474125 Oct 02 00:55:58.408170 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 92/170] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:57 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:55:59.288652 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:59.289269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:59.298236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:59.299696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:59.300348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:59.301435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:59.302239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:59.303011 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:59.319596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] HTTP exception thrown: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Request method failure captured: Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 HTTP/1.1 Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFSramSXRCM-xnmbeu8vzpS4vAquqXZh17bI_apE6TXgNwHI9l_HMqgcfUkpjDdbJ7pEVg0oOSm-bSHEy5AVZYUUAqa19aYBWa2OAUETFoU8ZBWbbtnt7Vibs9TbSxd6gfPlIcdtX_8LoQz1sewmNhJm_R1Tdi7epHBgnrXl-6uoLM Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 3e983e7eb1474850a440d1e022c7c5a9 Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 00:55:59.326347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e983e7eb1474850a440d1e022c7c5a9"}]}] Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 3e983e7eb1474850a440d1e022c7c5a9 Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-1912878779-project Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: ee548b86b214493e83a00964137c4fde Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-1912878779-project Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.327606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': 'abd2929d-fbbf-498d-881f-142ede942767'} Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:55:59.328277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.329365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.332563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Returning 404 to user: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:55:59.334281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8d9f435-747e-4c19-9c09-5efc33ab5723 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 404 len: 111 microversion: 2.1 time: 0.049328 Oct 02 00:55:59.335360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 79/171] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:59 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:55:59.438993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:59.440227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:59.449392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:59.449934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:59.450458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:59.457500 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:59.458782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:59.460615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:59.473845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:55:59.476502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:55:59.496793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:59.498425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:59.499469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:59.500794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:55:59.503250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:55:59.505441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:55:59.538856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] HTTP exception thrown: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Request method failure captured: Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767/os-volume_attachments HTTP/1.1 Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFSramSXRCM-xnmbeu8vzpS4vAquqXZh17bI_apE6TXgNwHI9l_HMqgcfUkpjDdbJ7pEVg0oOSm-bSHEy5AVZYUUAqa19aYBWa2OAUETFoU8ZBWbbtnt7Vibs9TbSxd6gfPlIcdtX_8LoQz1sewmNhJm_R1Tdi7epHBgnrXl-6uoLM Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 3e983e7eb1474850a440d1e022c7c5a9 Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 00:55:59.541699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e983e7eb1474850a440d1e022c7c5a9"}]}] Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 3e983e7eb1474850a440d1e022c7c5a9 Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-1912878779-project Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: ee548b86b214493e83a00964137c4fde Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-1912878779-project Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.543099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'server_id': 'abd2929d-fbbf-498d-881f-142ede942767'} Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:55:59.543797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:55:59.544976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:55:59.547640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Returning 404 to user: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:55:59.549833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6159fb4d-cd66-4cfc-9ec9-555eff070029 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.080097 Oct 02 00:55:59.550992 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 80/172] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 00:55:59 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:55:59.798794 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:55:59.828887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d58fab9b-6340-414a-b14b-0bd6586e6112 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.391890 Oct 02 00:55:59.833349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 93/173] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:55:59 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:00.858081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:00.858722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:00.876469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:00.877017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:00.877527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:00.878643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:00.879386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:00.885553 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:00.886084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:00.889233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:00.897455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:00.898053 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:00.898415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:00.902292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:00.903185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:00.906287 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:00.954013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] HTTP exception thrown: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Request method failure captured: Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 HTTP/1.1 Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFSramSXRCM-xnmbeu8vzpS4vAquqXZh17bI_apE6TXgNwHI9l_HMqgcfUkpjDdbJ7pEVg0oOSm-bSHEy5AVZYUUAqa19aYBWa2OAUETFoU8ZBWbbtnt7Vibs9TbSxd6gfPlIcdtX_8LoQz1sewmNhJm_R1Tdi7epHBgnrXl-6uoLM Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 3e983e7eb1474850a440d1e022c7c5a9 Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:56:00.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e983e7eb1474850a440d1e022c7c5a9"}]}] Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 3e983e7eb1474850a440d1e022c7c5a9 Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-DeleteServersTestJSON-1912878779-project Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: ee548b86b214493e83a00964137c4fde Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-DeleteServersTestJSON-1912878779-project Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:00.965394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': 'abd2929d-fbbf-498d-881f-142ede942767'} Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:00.966043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:00.967131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:00.970243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Returning 404 to user: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:00.973623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-90ab9c8f-9ce8-4f1b-b59c-0d9b12f4b90d tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "DELETE /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 404 len: 111 microversion: 2.1 time: 0.089071 Oct 02 00:56:00.974480 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 94/174] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 00:56:00 2022] DELETE /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:56:00.985537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:00.987256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] [instance: abd2929d-fbbf-498d-881f-142ede942767] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:00.997290 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:01.000100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:01.000836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:01.001797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:01.004050 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:01.004708 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:01.037782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] HTTP exception thrown: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Request method failure captured: Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 HTTP/1.1 Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFSramSXRCM-xnmbeu8vzpS4vAquqXZh17bI_apE6TXgNwHI9l_HMqgcfUkpjDdbJ7pEVg0oOSm-bSHEy5AVZYUUAqa19aYBWa2OAUETFoU8ZBWbbtnt7Vibs9TbSxd6gfPlIcdtX_8LoQz1sewmNhJm_R1Tdi7epHBgnrXl-6uoLM Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 3e983e7eb1474850a440d1e022c7c5a9 Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:56:01.039960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3e983e7eb1474850a440d1e022c7c5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3e983e7eb1474850a440d1e022c7c5a9"}]}] Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 3e983e7eb1474850a440d1e022c7c5a9 Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912878779 Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-DeleteServersTestJSON-1912878779-project Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: ee548b86b214493e83a00964137c4fde Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-DeleteServersTestJSON-1912878779-project Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:01.041356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': 'abd2929d-fbbf-498d-881f-142ede942767'} Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:01.042109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. Oct 02 00:56:01.043218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:56:01.045886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] Returning 404 to user: Instance abd2929d-fbbf-498d-881f-142ede942767 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:01.046950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b5fd7741-5fd6-4b79-a0ae-e5292c2b9f46 tempest-DeleteServersTestJSON-1912878779 tempest-DeleteServersTestJSON-1912878779-project] 10.222.0.25 "GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767" status: 404 len: 111 microversion: 2.1 time: 0.068185 Oct 02 00:56:01.048169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 95/175] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:00 2022] GET /compute/v2.1/servers/abd2929d-fbbf-498d-881f-142ede942767 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:56:01.201279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:01.227951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d7894de-53ce-4fc0-ad00-328280253787 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.370980 Oct 02 00:56:01.227951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 81/176] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:00 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:02.253012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:02.255958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:02.263925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:02.264890 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:02.266199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:02.268319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:02.268968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:02.270611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:02.471944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:02.480607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fa2fcc20-f2af-4c93-a5de-63c5bdfda09c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.232252 Oct 02 00:56:02.481257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 96/177] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:02 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:03.507256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:03.508623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:03.522912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:03.524365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:03.526735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:03.527825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:03.531175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:03.532260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:03.867719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:03.876510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11b70c80-7444-488d-9658-325c7b4afc59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.372995 Oct 02 00:56:03.894768 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 82/178] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:03 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:04.910473 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:04.911739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:04.927697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:04.928579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:04.930178 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:04.931777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:04.933797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:04.935506 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:05.327764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:05.337699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-47c4373c-df5e-43a3-9e85-d675758c9198 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.433333 Oct 02 00:56:05.340756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 97/179] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:04 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:06.367477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:06.373925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:06.393639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:06.395047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:06.399266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:06.400336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:06.401020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:06.401690 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:06.846222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:06.856014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad1856dd-f593-4737-91d9-73b48bc7ebdf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.493373 Oct 02 00:56:06.870089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 83/180] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:06 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:07.884945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:07.886292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:07.895926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:07.895926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:07.896269 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:07.913661 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:07.914278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:07.919716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:08.243016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:08.262375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6490eb3c-a051-4dcf-9012-9ed06c3db862 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.383456 Oct 02 00:56:08.270770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 98/181] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:07 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:09.291540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:09.292164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:09.303161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:09.303511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:09.307463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:09.308822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:09.309648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:09.311517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:09.355056 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:09.582282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:09.591988 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b66b92e2-c019-41b6-8384-3593b3b7978f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.304552 Oct 02 00:56:09.593126 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 84/182] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:09 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:10.618143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:10.618895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:10.628749 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:10.629246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:10.629747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:10.630404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:10.631020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:10.631683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:10.898289 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:10.906666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:10.919395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-61ca2de4-721d-4e55-887d-fe2d7e6895a9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.303784 Oct 02 00:56:10.921312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 99/183] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:10 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:11.947643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:11.948263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:11.957193 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:11.958239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:11.959791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:11.962580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:11.965888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:11.973029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:12.247867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:12.273201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1262af2-77be-44ec-8c31-cdd10014307e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.326951 Oct 02 00:56:12.275056 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 85/184] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:11 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:13.296938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:13.298153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:13.325917 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:13.327119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:13.327576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:13.331545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:13.332940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:13.334986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:13.597466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:13.611907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-13f4a359-e794-40e2-b4f3-df81a789ba5c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.318770 Oct 02 00:56:13.615826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 100/185] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:13 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:14.638815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:14.640225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:14.651091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:14.672742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:14.673410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:14.674222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:14.683503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:14.686134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:14.981051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:14.992966 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3c2aa18-4ce3-4009-a774-2586a8af2343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.359401 Oct 02 00:56:14.999145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 86/186] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:14 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:16.029292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:16.031459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:16.057738 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:16.058502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:16.059086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:16.059968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:16.061022 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:16.061979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:16.426575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:16.435161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7c7bec63-2338-4b98-95db-ff6ec2e07418 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.410491 Oct 02 00:56:16.440430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 101/187] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:16 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:17.464864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:17.465495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:17.468316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=34 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:17.482479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:17.482992 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:17.483650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:17.485004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:17.486210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:17.486796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:17.832074 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:17.849370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-058a8909-e57f-4ea4-9652-054e2645eb68 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1522 microversion: 2.1 time: 0.388256 Oct 02 00:56:17.849961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 87/188] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:17 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:18.882172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:18.882995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:18.897199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:18.913966 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:18.918886 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:18.919954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:18.922028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:18.923426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:19.372901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:19.399871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-395dc7af-a99c-40f1-95e7-470d1ef6d1c3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1502 microversion: 2.1 time: 0.528344 Oct 02 00:56:19.400917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 88/189] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:18 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1502 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:19.422892 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:19.423639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:19.430098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:19.431419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:19.431929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:19.433164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:19.433709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:19.434252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:19.572321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-251505fa-3742-493e-be89-0f1406bff54f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'create', calling method: .version_select at 0x7f6e790b4430>, body: {"keypair": {"name": "tempest-keypair-991347848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe1Oza2wHE0Uai+u/bemZC5xulF9GnebJ4sYf3vHU2MBrC4tLU7LlTwNubNjXBrHCU25FQPlfD+u7ohyCD6I1zcISd+WLysNRyOYOV3JNdCSHK2pCRczgvtaXAi5uk5fw=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:19.583832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:19.607599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-251505fa-3742-493e-be89-0f1406bff54f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Getting quotas for project 6f2f218a688a41ab9e06269c4be3973d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:19.623908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-251505fa-3742-493e-be89-0f1406bff54f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Getting quotas for user 6415bc1076204c78ad819ab2836a3652 and project 6f2f218a688a41ab9e06269c4be3973d. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:19.672241 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-251505fa-3742-493e-be89-0f1406bff54f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.859115 Oct 02 00:56:19.672851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 102/190] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 00:56:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:19.686224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:19.696617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df632d3d-d02a-455a-9251-2f22df6f6683 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1515 microversion: 2.1 time: 0.278408 Oct 02 00:56:19.703494 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 89/191] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:19 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1515 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:19.972024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4e5411d3-14c6-426e-834e-c0f4f989a37a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Action: 'create', calling method: .version_select at 0x7f6e790c1f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-457258283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgQvyoCPZZZQN+989/ZH7Y3XRkQ3YhlggZKf8aKT6pE0IPiXpQnn8w10K5l/kXx1Wxe0TvU1anFwwo8k8EbonC+JvVnyi67DK6l4JHPEhj7n8rIXge13gWoo4EjpvGcag=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:20.013937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-4e5411d3-14c6-426e-834e-c0f4f989a37a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Getting quotas for project 302dd84b0b90485691447badb4536c56. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:20.020201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-4e5411d3-14c6-426e-834e-c0f4f989a37a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Getting quotas for user bfee7d93eeff4e728abea067c0c42814 and project 302dd84b0b90485691447badb4536c56. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:20.099138 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4e5411d3-14c6-426e-834e-c0f4f989a37a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.424661 Oct 02 00:56:20.106013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 103/192] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 00:56:19 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:21.449454 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:21.451842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:21.458881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:21.461214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:21.462014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:21.463104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:21.463902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:21.464668 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:21.495446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lazy-loading 'flavor' on Instance uuid 6686edd9-ff59-4ebd-9253-f49114e9a954 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:56:21.631945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b54f32ec-6bf6-4ccb-8612-1d24c0326087 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954/action" status: 200 len: 32 microversion: 2.1 time: 0.186898 Oct 02 00:56:21.634016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 90/193] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:56:21 2022] POST /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:56:21.643440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:21.644061 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:21.651855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:21.660055 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:21.660055 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:21.660055 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:21.660304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:21.660856 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:21.901853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:21.912786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0416844c-f9ac-4bcb-91e8-e707ccbee094 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.273101 Oct 02 00:56:21.913831 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 104/194] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:21 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:22.889113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1473962494", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67365c61-9e99-4ca0-9e2a-e74a0e5c1767"}], "security_groups": [{"name": "tempest-securitygroup--264468964"}], "key_name": "tempest-keypair-991347848", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:22.936171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:22.936935 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:22.945477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:22.945882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:22.946349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:22.951737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:22.952297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:22.952751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:23.203331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] validate_networks() for [('67365c61-9e99-4ca0-9e2a-e74a0e5c1767', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:56:23.401142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:23.413394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-79a4541f-2e95-4596-a11b-a52c39292c90 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.481019 Oct 02 00:56:23.413980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 105/195] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:22 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:23.818726 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:56:23.819146 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:56:23.819625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:56:23.820212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:56:23.820612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:56:23.843294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:23.843779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:23.844277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:23.845063 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:23.845517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:23.846195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:23.871795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Getting quotas for project 6f2f218a688a41ab9e06269c4be3973d. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:23.876024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Getting quotas for user 6415bc1076204c78ad819ab2836a3652 and project 6f2f218a688a41ab9e06269c4be3973d. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:23.887940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:56:23.890880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:56:23.968715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e913d2e-4a5b-425c-8e20-e7c587c9c766 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.084627 Oct 02 00:56:23.973000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 91/196] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 00:56:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:56:23.993744 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5fc48696-927f-4337-96ab-b1c49ca72ac0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:23.994427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5fc48696-927f-4337-96ab-b1c49ca72ac0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:24.059717 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5fc48696-927f-4337-96ab-b1c49ca72ac0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:24.067189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5fc48696-927f-4337-96ab-b1c49ca72ac0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1237 microversion: 2.1 time: 0.087239 Oct 02 00:56:24.069171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 106/197] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:23 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:24.447435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:24.448078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:24.456138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:24.456636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:24.457060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:24.457945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:24.458578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:24.459163 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:24.711455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:24.721331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a7cfed3b-97eb-4cdc-a0a4-fc60909ca27d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.287044 Oct 02 00:56:24.723061 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 92/198] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:24 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:25.090911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:25.092212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:25.109826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:25.111049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:25.112440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:25.114215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:25.115170 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:25.118842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:25.288663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:25.303076 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6f411d7b-aced-469c-9606-6186ee31fccf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1289 microversion: 2.1 time: 0.217047 Oct 02 00:56:25.321043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 107/199] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:25 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1289 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:25.751398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:25.752245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:25.765585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:25.781955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:25.782334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:25.782954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:25.783426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:25.783952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:26.229449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:26.237473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ce39810-fbcb-41d2-a590-0363f6f7c52b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.493545 Oct 02 00:56:26.238102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 93/200] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:25 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:26.330820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:26.331461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:26.343739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:26.344244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:26.349373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:26.350212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:26.350701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:26.351142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:26.442920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:26.454357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1966a5ae-a999-497a-9ac8-685d7c1d3c35 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1295 microversion: 2.1 time: 0.130723 Oct 02 00:56:26.472463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 108/201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:26 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1295 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:27.260812 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:27.261531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:27.272964 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:27.273461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:27.275033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:27.276015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:27.278863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:27.279482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:27.489321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:27.490610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:27.501418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:27.502214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:27.502916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:27.504358 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:27.505060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:27.505711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:27.741870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:27.753177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-11cd48c7-a601-4015-9b79-f31690b9528c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1295 microversion: 2.1 time: 0.269987 Oct 02 00:56:27.754737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 109/202] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:27 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1295 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:27.820536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:27.829838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94ab8413-500f-4ee8-9f1e-682bbfa53633 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.572412 Oct 02 00:56:27.830757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 94/203] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:27 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:28.780830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:28.782648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:28.808141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:28.808886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:28.810938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:28.811925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:28.813600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:28.814616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:28.855163 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:28.855788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:28.864486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:28.865278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:28.865938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:28.866920 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:28.867822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:28.869135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:29.154639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:29.161643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:29.172115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7fe654e5-3b83-487a-9823-7f439d360135 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.321326 Oct 02 00:56:29.172745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 95/204] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:28 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:29.175763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-66b40cd7-475d-4caa-9eb7-d16998c98acc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1362 microversion: 2.1 time: 0.398902 Oct 02 00:56:29.177017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 110/205] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:28 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:29.183032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-af9bfc01-a800-4bc9-a2e1-f2073d0fb4b2 req-39bb9d83-cf1d-4476-9ddb-4aa8fbd21e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f31c21f-46c0-4906-b0fd-ca8fb00439e8", "tag": "429a9a97-9227-4530-a76b-a3eb80df7412"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:29.199158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-af9bfc01-a800-4bc9-a2e1-f2073d0fb4b2 req-39bb9d83-cf1d-4476-9ddb-4aa8fbd21e1c service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:29.199879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-af9bfc01-a800-4bc9-a2e1-f2073d0fb4b2 req-39bb9d83-cf1d-4476-9ddb-4aa8fbd21e1c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:29.200511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-af9bfc01-a800-4bc9-a2e1-f2073d0fb4b2 req-39bb9d83-cf1d-4476-9ddb-4aa8fbd21e1c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:29.220277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-af9bfc01-a800-4bc9-a2e1-f2073d0fb4b2 req-39bb9d83-cf1d-4476-9ddb-4aa8fbd21e1c service nova] Creating event network-changed:429a9a97-9227-4530-a76b-a3eb80df7412 for instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 on hv-cinder-maste Oct 02 00:56:29.236118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-af9bfc01-a800-4bc9-a2e1-f2073d0fb4b2 req-39bb9d83-cf1d-4476-9ddb-4aa8fbd21e1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058873 Oct 02 00:56:29.238121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 96/206] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:30.201580 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:30.202161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:30.202961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:30.203097 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:30.211006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:30.211596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:30.212090 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:30.213076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:30.213606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:30.214111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:30.218838 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:30.220981 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:30.221802 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:30.223118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:30.223933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:30.224695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:30.496606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:30.498667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:30.511628 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e57480a8-2de5-489e-8fc3-f65377ad2548 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1362 microversion: 2.1 time: 0.316522 Oct 02 00:56:30.512670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 97/207] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:30 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:30.538558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e89a9d67-371a-4c45-9410-c707b474724b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.344364 Oct 02 00:56:30.566172 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 111/208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:30 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:31.540054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:31.540944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:31.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:31.548856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:31.549284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:31.549976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:31.550476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:31.550895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:31.569593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:31.575872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:31.582823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:31.583317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:31.583965 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:31.584836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:31.585301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:31.585726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:31.778233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:31.789333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90fb8a7a-0669-4d82-866f-d0b197d8095f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1362 microversion: 2.1 time: 0.253324 Oct 02 00:56:31.789486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:31.790684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 98/209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:31 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:31.798403 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-122cd391-a09a-4232-9502-675c12e17ede tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.233197 Oct 02 00:56:31.810666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 112/210] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:31 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:32.814209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:32.814748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:32.821698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:32.822270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:32.822717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:32.823416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:32.823964 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:32.824087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:32.824501 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:32.824580 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:32.831117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:32.831791 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:32.832281 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:32.832985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:32.833593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:32.834025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:33.017652 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:33.038480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1be3eb43-bc73-4456-903d-7c0a588b87e0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1362 microversion: 2.1 time: 0.228274 Oct 02 00:56:33.039930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 99/211] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:32 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:33.057229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:33.072002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d659d656-742d-454a-9b23-e50eee27ed80 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.252805 Oct 02 00:56:33.082949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 113/212] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:32 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:34.066721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:34.067339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:34.069716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:34.070528 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:34.076319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:34.076800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:34.077270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:34.078007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:34.078531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:34.078957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:34.083707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:34.106707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:34.107997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:34.118240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=10 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:34.121478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:34.122910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:34.123525 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:34.124545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:34.125062 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:34.125674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:34.276590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:34.285921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-37053a69-533d-4809-b6d2-38faf90a0337 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1362 microversion: 2.1 time: 0.223125 Oct 02 00:56:34.286971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 100/213] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:34 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:34.317578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:34.327035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-20547fbf-d887-4de8-a86f-f1d45fbf780c tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.225837 Oct 02 00:56:34.327614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 114/214] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:34 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:35.308882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:35.309420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:35.316353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:35.316835 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:35.317295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:35.317974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:35.318447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:35.318865 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:35.351548 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:35.352199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:35.358438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:35.358966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:35.359451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:35.360800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:35.361295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:35.361761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:35.492083 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:35.500044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-209c6a78-7af0-43df-820b-54aff74772e5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1362 microversion: 2.1 time: 0.195160 Oct 02 00:56:35.500700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 101/215] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:35 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:35.526515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:35.535266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e3d357d6-55c3-4eb5-ad4f-822fd2dfa35b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.187534 Oct 02 00:56:35.535842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 115/216] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:35 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:35.969076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eaaf99f1-09c0-451e-bf70-48b516aa3a48 req-090e8542-376a-4a33-9c43-1635741ca906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f31c21f-46c0-4906-b0fd-ca8fb00439e8", "name": "network-vif-plugged", "status": "completed", "tag": "429a9a97-9227-4530-a76b-a3eb80df7412"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:35.979606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eaaf99f1-09c0-451e-bf70-48b516aa3a48 req-090e8542-376a-4a33-9c43-1635741ca906 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:35.980091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eaaf99f1-09c0-451e-bf70-48b516aa3a48 req-090e8542-376a-4a33-9c43-1635741ca906 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:35.980519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eaaf99f1-09c0-451e-bf70-48b516aa3a48 req-090e8542-376a-4a33-9c43-1635741ca906 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:35.992676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eaaf99f1-09c0-451e-bf70-48b516aa3a48 req-090e8542-376a-4a33-9c43-1635741ca906 service nova] Creating event network-vif-plugged:429a9a97-9227-4530-a76b-a3eb80df7412 for instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 on hv-cinder-maste Oct 02 00:56:35.998013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eaaf99f1-09c0-451e-bf70-48b516aa3a48 req-090e8542-376a-4a33-9c43-1635741ca906 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034136 Oct 02 00:56:35.998636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 102/217] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:36.522333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:36.523121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:36.530023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:36.530659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:36.531214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:36.532064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:36.532719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:36.533230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:36.560091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:36.560708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:36.567640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:36.568127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:36.568568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:36.569265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:36.569724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:36.570190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:36.719906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:36.730565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c9e1dcb1-95b8-412b-be23-4ed9896bef24 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1362 microversion: 2.1 time: 0.212244 Oct 02 00:56:36.731150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 116/218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:36 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:36.751943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:36.759627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0446af42-5c8e-4c3d-b49d-44c124044119 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.204493 Oct 02 00:56:36.760422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 103/219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:36 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:37.757266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:37.757266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:37.762089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:37.762781 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:37.763295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:37.764071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:37.764687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:37.765046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:37.784734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:37.785514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:37.792667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:37.797110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:37.799821 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:37.800857 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:37.801533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:37.805870 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:37.953058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:37.961682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-581405a3-591b-45bb-8255-a7706a9fa861 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1362 microversion: 2.1 time: 0.210280 Oct 02 00:56:37.962404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 117/220] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:37 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:37.998017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:38.005783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ff5dd929-b544-42b9-b11c-c7b768a3b6d8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.225275 Oct 02 00:56:38.006391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 104/221] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:37 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:38.102010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8ba7deab-a036-4cd8-b6b7-7ce34a3c6549 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:38.103102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8ba7deab-a036-4cd8-b6b7-7ce34a3c6549 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:38.110543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ba7deab-a036-4cd8-b6b7-7ce34a3c6549 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:38.111367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ba7deab-a036-4cd8-b6b7-7ce34a3c6549 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:38.112122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ba7deab-a036-4cd8-b6b7-7ce34a3c6549 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:38.112836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ba7deab-a036-4cd8-b6b7-7ce34a3c6549 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:38.113370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ba7deab-a036-4cd8-b6b7-7ce34a3c6549 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:38.113962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ba7deab-a036-4cd8-b6b7-7ce34a3c6549 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:38.138387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8ba7deab-a036-4cd8-b6b7-7ce34a3c6549 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/ips" status: 200 len: 152 microversion: 2.20 time: 0.040335 Oct 02 00:56:38.138958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 118/222] 10.222.0.25 () {60 vars in 1289 bytes} [Sun Oct 2 00:56:38 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:56:38.985596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:38.986349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:38.993941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:38.994474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:38.995234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:38.995971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:38.996439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:38.996871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:39.029395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:39.030237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:39.040279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:39.040775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:39.041451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:39.041952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:39.042433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:39.042858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:39.181377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:39.189688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-919f5693-bd46-4c6d-b1ad-4497992e0270 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1548 microversion: 2.1 time: 0.208672 Oct 02 00:56:39.190377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 105/223] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:38 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1548 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:39.212571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62b29f1d-1454-4ab3-be58-6771225ff370 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:39.213073 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62b29f1d-1454-4ab3-be58-6771225ff370 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:39.214527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:39.218004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:39.220348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b29f1d-1454-4ab3-be58-6771225ff370 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:39.220848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b29f1d-1454-4ab3-be58-6771225ff370 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:39.221285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b29f1d-1454-4ab3-be58-6771225ff370 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:39.222002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b29f1d-1454-4ab3-be58-6771225ff370 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:39.222488 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b29f1d-1454-4ab3-be58-6771225ff370 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:39.222917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b29f1d-1454-4ab3-be58-6771225ff370 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:39.223701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3b21c5ca-97e6-42ec-aa1d-590101fb886b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.198922 Oct 02 00:56:39.224253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 119/224] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:39 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:39.304070 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62b29f1d-1454-4ab3-be58-6771225ff370 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095781 Oct 02 00:56:39.305371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 106/225] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Oct 2 00:56:39 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:56:40.114205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:40.114728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:40.121427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:40.121942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:40.122402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:40.123136 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:40.123737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:40.124260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:40.149451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lazy-loading 'flavor' on Instance uuid 6c4241ee-1589-42f2-986e-abe5f0a2c369 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:56:40.255036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:40.258313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:40.271101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:40.273360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:40.273834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:40.276360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:40.278804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:40.279533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:40.473349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:40.486452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98781283-ab12-46ab-9298-f727e53f564e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.243426 Oct 02 00:56:40.489222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 107/226] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:40 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:40.500205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4d234364-27d2-4854-85ba-a855fd5d5702 req-ca71ad02-cefa-4e62-a5a7-3d3132dab7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f31c21f-46c0-4906-b0fd-ca8fb00439e8", "tag": "429a9a97-9227-4530-a76b-a3eb80df7412"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:40.512322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4d234364-27d2-4854-85ba-a855fd5d5702 req-ca71ad02-cefa-4e62-a5a7-3d3132dab7b6 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:40.513278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4d234364-27d2-4854-85ba-a855fd5d5702 req-ca71ad02-cefa-4e62-a5a7-3d3132dab7b6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:40.514003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4d234364-27d2-4854-85ba-a855fd5d5702 req-ca71ad02-cefa-4e62-a5a7-3d3132dab7b6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:40.530743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4d234364-27d2-4854-85ba-a855fd5d5702 req-ca71ad02-cefa-4e62-a5a7-3d3132dab7b6 service nova] Creating event network-changed:429a9a97-9227-4530-a76b-a3eb80df7412 for instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 on hv-cinder-maste Oct 02 00:56:40.536819 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4d234364-27d2-4854-85ba-a855fd5d5702 req-ca71ad02-cefa-4e62-a5a7-3d3132dab7b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045751 Oct 02 00:56:40.542432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 108/227] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:41.513235 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:41.513922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:41.521330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:41.521809 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:41.522278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:41.522972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:41.523426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:41.523854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:41.710247 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:41.719210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-100f7937-c870-438c-b8d4-be8e15e3a4a1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.210082 Oct 02 00:56:41.719826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 109/228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:41 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:41.915088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-15a82d8c-3e0b-4bdf-a8e8-f7a8421d9ed7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/action" status: 202 len: 0 microversion: 2.20 time: 1.804444 Oct 02 00:56:41.915824 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 120/229] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Oct 2 00:56:40 2022] POST /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/action => generated 0 bytes in 1806 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:56:41.926827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:41.927439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:41.933800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:41.934407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:41.934975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:41.935666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:41.936230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:41.937317 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:42.083904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:42.092621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:42.094790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:42.097328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b4b8dac-e905-49aa-bbdf-329b9a34ef3b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.175716 Oct 02 00:56:42.097883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 110/230] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:41 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:42.744035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:42.744664 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:42.751692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:42.752166 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:42.752597 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:42.753281 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:42.753732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:42.754181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:42.885309 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:42.893619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-196cdc43-dd14-47f8-97b1-f53c05504dbf tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.154145 Oct 02 00:56:42.894205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 121/231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:42 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:43.123592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:43.124199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:43.130751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:43.131238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:43.131669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:43.132412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:43.132864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:43.133289 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:43.263989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:43.273495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:43.275256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:43.276717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-25918bd9-47de-40eb-9aa2-a647201c1a23 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.157221 Oct 02 00:56:43.277627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 111/232] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:43 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:43.917620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:43.918254 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:43.924544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:43.925021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:43.925451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:43.926166 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:43.926615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:43.927031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:44.148170 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:44.156835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-38d86118-d6d9-420d-a656-80aa13ac5c7d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.243816 Oct 02 00:56:44.176122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 122/233] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:43 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:44.303087 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:44.303818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:44.310639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:44.311108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:44.311541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:44.312235 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:44.313286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:44.313897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:44.444917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:44.453035 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:44.454485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:44.455664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10a4a083-93ca-4581-8449-b5246f0747ae tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.156483 Oct 02 00:56:44.456430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 112/234] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:44 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:45.180628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:45.181386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:45.188108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:45.188671 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:45.189109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:45.189798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:45.190281 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:45.190701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:45.323934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:45.336896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-007f3dfa-a270-4cb0-8fbd-1c7cd400c0f1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.159917 Oct 02 00:56:45.338120 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 123/235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:45 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:45.480991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:45.481595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:45.488665 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:45.489142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:45.489613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:45.490296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:45.490746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:45.491196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:45.630626 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:45.638805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:45.640226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:45.641985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1560a67a-9303-43ea-b2b1-1d50aac5dfbc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.164834 Oct 02 00:56:45.642574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 113/236] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:45 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:46.361286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:46.362263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:46.368100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.368586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.369024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.369712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.370458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.370881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.503132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:46.511288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e58a4b43-22b5-49cf-938a-9031f1678069 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1501 microversion: 2.1 time: 0.154468 Oct 02 00:56:46.511862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 124/237] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:46 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:46.534173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0247cf71-196a-42b5-924c-e53720f38dc1"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:46.536541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:46.543255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.543765 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.544196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.544893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.545347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.545766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.668537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:46.669670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:46.680216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.680711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.681148 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.681855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.682336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.682765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.712366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] HTTP exception thrown: Cannot 'attach_volume' instance 6686edd9-ff59-4ebd-9253-f49114e9a954 while it is in vm_state rescued Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Request method failure captured: Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954/os-volume_attachments HTTP/1.1 Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 74 Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFUgOoUORwJ-4C5H8x8ZefgUoj4fAo-4b23BL6QAt32ZVq1eedL7jjmzmZypIIqDsNbc0fqOIf2a45OsXp6o7sSnuTA6QBpSRBCFf7589pfDKBt35NHaCDH0aODsbLAt7rzkOX9wrlTWiwdiGrNamlUUvOi1ygyyHlw2deknU-cbG8 Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 00:56:46.713974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}] Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: afe98894d83f4678bb134782d90706e8 Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {"volumeAttachment": {"volumeId": "0247cf71-196a-42b5-924c-e53720f38dc1"}} Oct 02 00:56:46.715532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Cannot 'attach_volume' instance 6686edd9-ff59-4ebd-9253-f49114e9a954 while it is in vm_state rescued Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'server_id': '6686edd9-ff59-4ebd-9253-f49114e9a954', 'body': {'volumeAttachment': {'volumeId': '0247cf71-196a-42b5-924c-e53720f38dc1'}}} Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6686edd9-ff59-4ebd-9253-f49114e9a954 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:56:46.716312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6686edd9-ff59-4ebd-9253-f49114e9a954 while it is in vm_state rescued Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:56:46.717511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:56:46.719832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:56:46.719832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:56:46.719832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6686edd9-ff59-4ebd-9253-f49114e9a954 while it is in vm_state rescued Oct 02 00:56:46.719832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:56:46.719832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Returning 409 to user: Cannot 'attach_volume' instance 6686edd9-ff59-4ebd-9253-f49114e9a954 while it is in vm_state rescued {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:56:46.719832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b855298-6a9c-4fa2-9a46-e9ba43d6a343 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.185290 Oct 02 00:56:46.719832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 114/238] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 00:56:46 2022] POST /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954/os-volume_attachments => generated 152 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 00:56:46.727179 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-034be205-37d1-4c57-833f-019bb687a6e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:46.727714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-034be205-37d1-4c57-833f-019bb687a6e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:46.734601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034be205-37d1-4c57-833f-019bb687a6e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.735156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034be205-37d1-4c57-833f-019bb687a6e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.735872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034be205-37d1-4c57-833f-019bb687a6e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.736809 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034be205-37d1-4c57-833f-019bb687a6e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.737330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034be205-37d1-4c57-833f-019bb687a6e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.737923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034be205-37d1-4c57-833f-019bb687a6e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.821742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-034be205-37d1-4c57-833f-019bb687a6e1 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954/action" status: 202 len: 0 microversion: 2.1 time: 0.098291 Oct 02 00:56:46.826094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 115/239] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:56:46 2022] POST /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:56:46.833262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:46.833989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:46.840413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.840970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.841702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:46.842842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:46.843369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:46.844452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:47.215710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:47.229833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:47.232025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:47.233665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f7be5d9d-a844-49fd-9958-22003458f264 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.568965 Oct 02 00:56:47.235025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 125/240] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:46 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:47.242203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:47.251328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9bde245-8340-4f44-be2d-cc94b253a805 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1509 microversion: 2.1 time: 0.423785 Oct 02 00:56:47.252429 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 116/241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:46 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:47.857140 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1269183565", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-457258283", "security_groups": [{"name": "tempest-secgroup-smoke-1621657040"}], "networks": [{"uuid": "c50cdaed-f77c-4fe6-b21a-2b48afe54a30"}], "block_device_mapping_v2": [{"uuid": "26818ee3-8b84-4601-9ff6-82df55a57e24", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:47.996999 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] validate_networks() for [('c50cdaed-f77c-4fe6-b21a-2b48afe54a30', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:56:48.271982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:48.272564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:48.274935 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:48.280313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.280815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.281770 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.282570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.283026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.283448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.451295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:56:48.451727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:56:48.452219 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:56:48.452619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:56:48.453743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:56:48.462503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.463025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.463463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.464196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.464652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.465078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.478710 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:48.480915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:48.483546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Getting quotas for project 302dd84b0b90485691447badb4536c56. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:48.487720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Getting quotas for user bfee7d93eeff4e728abea067c0c42814 and project 302dd84b0b90485691447badb4536c56. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:48.487984 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:48.489435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:48.490605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66c06494-1fe8-406e-88e3-3989cda9d315 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.223080 Oct 02 00:56:48.491158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 117/242] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:48 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:56:48.496234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:48.496838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:48.502687 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.503179 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.503618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.504306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:48.504761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:48.505186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:48.550272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:56:48.552447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26818ee3-8b84-4601-9ff6-82df55a57e24',volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:56:48.639458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:48.647899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fdffcd32-77f7-4fa7-9ccc-c5e9d54e3c5b tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1509 microversion: 2.1 time: 0.155810 Oct 02 00:56:48.648555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 118/243] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:48 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:48.684161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-694d2e80-6b21-48f1-982c-46edd70261a5 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.830919 Oct 02 00:56:48.684809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 126/244] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 00:56:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:56:48.695819 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57edc3a4-887a-4791-890b-95467f5798f9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:48.696522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57edc3a4-887a-4791-890b-95467f5798f9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:48.752369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-57edc3a4-887a-4791-890b-95467f5798f9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:48.759555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57edc3a4-887a-4791-890b-95467f5798f9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1088 microversion: 2.1 time: 0.067671 Oct 02 00:56:48.763517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 119/245] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:48 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:49.518087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:49.518793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:49.524938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:49.525511 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:49.526676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.527582 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:49.528087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:49.528669 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.672286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:49.673606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:49.684620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:49.685049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:49.693311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.694291 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:49.694904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:49.695610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.804362 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.813113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.814586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.815740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7b56b2dd-f5ac-4203-896d-bcda93c93713 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.302741 Oct 02 00:56:49.816603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 127/246] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:49 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:49.821863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:49.822425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:49.824528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:49.831719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:49.832611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:49.833887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.834811 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:49.835409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:49.835975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:49.884256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.896167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db725ae6-bf35-46ce-95e3-04595da2d052 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1509 microversion: 2.1 time: 0.228762 Oct 02 00:56:49.896742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 120/247] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:49 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:49.924544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:49.932459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3a1141cd-1f48-47c9-96c4-a743582c057e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1186 microversion: 2.1 time: 0.114206 Oct 02 00:56:49.933040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 128/248] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:49 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:50.844238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:50.844869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:50.851364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.851837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.852296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:50.853013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.853425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.853846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:50.920642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:50.922315 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:50.930070 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.930571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.931012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:50.931718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:50.932173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:50.932787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:51.041051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.053261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.061792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.063559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8af4d79-54e0-4ced-b404-7e0246f0b350 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.222826 Oct 02 00:56:51.064645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 121/249] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:50 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:51.082999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:51.083792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:51.089898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:51.090403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:51.090829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:51.091563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:51.092067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:51.092664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:51.109626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.118937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-634cc24d-dd1d-44d1-8f5c-4158944a57cd tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1515 microversion: 2.1 time: 0.203130 Oct 02 00:56:51.120472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 129/250] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:50 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:51.164042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:51.176537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a4750f96-4fa7-4d50-81b4-70142c656629 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1194 microversion: 2.1 time: 0.110712 Oct 02 00:56:51.181697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 122/251] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:51 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:52.090789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:52.091404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:52.097809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:52.098323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:52.098754 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:52.099650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:52.100080 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:52.100511 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:52.200700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:52.201315 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:52.208253 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:52.208742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:52.209172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:52.209883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:52.210372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:52.210797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:52.357774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:52.367186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:52.369340 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:52.372366 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-38183642-4879-4e60-84f1-8abe4c6be2c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.285439 Oct 02 00:56:52.373232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 130/252] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:52 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:56:52.466093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:52.475923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0f83d12-2486-4fcd-ab68-d372753e9a89 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1272 microversion: 2.1 time: 0.278620 Oct 02 00:56:52.476886 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 123/253] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:52 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:52.677573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d8ddf314-6a41-43ca-84b3-2bc180ef8219 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'create', calling method: .version_select at 0x7f6e790bc280>, body: {"keypair": {"name": "tempest-keypair-1507105558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhhYZ5TODuYcUnkh0OZj38Guhyw2Mzeqf7FaaoHLOZUGK606GmdKJ+a1r6cXJHKevM5K0FFZ7CbKr19xZZxWG5EAigxxlVv3kzfcSVBrVoiBv+5mpAlnoB3kMREihB2vA=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:52.702244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-d8ddf314-6a41-43ca-84b3-2bc180ef8219 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Getting quotas for project 4c22ffb83d7d41828375606fcc6da53f. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:52.702244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-d8ddf314-6a41-43ca-84b3-2bc180ef8219 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Getting quotas for user afe98894d83f4678bb134782d90706e8 and project 4c22ffb83d7d41828375606fcc6da53f. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:52.724600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d8ddf314-6a41-43ca-84b3-2bc180ef8219 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050611 Oct 02 00:56:52.734863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 131/254] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 00:56:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:53.356444 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a3e202cb-dc15-47ca-9707-ea7318744879 req-82799f16-3895-4da6-a956-3f1ee035a0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb223bc-04ab-40a1-91da-3a3900ed7c11", "tag": "35dfa250-2a82-4094-bfb8-cf1ecf3f6a10"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:53.372156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3e202cb-dc15-47ca-9707-ea7318744879 req-82799f16-3895-4da6-a956-3f1ee035a0c5 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.372935 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3e202cb-dc15-47ca-9707-ea7318744879 req-82799f16-3895-4da6-a956-3f1ee035a0c5 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.373585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3e202cb-dc15-47ca-9707-ea7318744879 req-82799f16-3895-4da6-a956-3f1ee035a0c5 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.387251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a3e202cb-dc15-47ca-9707-ea7318744879 req-82799f16-3895-4da6-a956-3f1ee035a0c5 service nova] Creating event network-changed:35dfa250-2a82-4094-bfb8-cf1ecf3f6a10 for instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 on hv-cinder-maste Oct 02 00:56:53.392900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a3e202cb-dc15-47ca-9707-ea7318744879 req-82799f16-3895-4da6-a956-3f1ee035a0c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040477 Oct 02 00:56:53.393513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 124/255] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:56:53.404020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:53.405332 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:53.413335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.413875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.414563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.415439 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.416042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.416478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.504805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:53.505514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:53.512356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.512850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.513346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.514357 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:53.515008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:53.516147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:53.686746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:53.696801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:53.698790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:53.700077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c3217ad1-18ce-40cd-96f6-3cb3fe221021 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.301424 Oct 02 00:56:53.718631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 132/256] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:53 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:56:53.774913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:53.783019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-38adadb0-ddb4-4480-85a4-012058c3d0a2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.282157 Oct 02 00:56:53.783591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 125/257] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:53 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:54.467747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1246127899", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac5bd4ad-3b24-4909-a4c7-09b260f667cc"}], "security_groups": [{"name": "tempest-securitygroup--448989523"}], "key_name": "tempest-keypair-1507105558", "user_data": "}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:56:54.611961 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] validate_networks() for [('ac5bd4ad-3b24-4909-a4c7-09b260f667cc', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:56:54.728440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:54.729188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:54.736551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.737038 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.737849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:54.738884 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.739378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.740103 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:54.951393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:54.959985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:54.961418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:54.962622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0de3f5b2-3d2c-4883-a4b4-8932316ed75a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.238116 Oct 02 00:56:54.963172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 126/258] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:54 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:54.967676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:54.968995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:54.974848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.975514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.976097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:54.976995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:54.977597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:54.978382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:55.396880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:55.405298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0641fe35-452f-4a72-9bee-c3f6bba2dc75 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.440825 Oct 02 00:56:55.408388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:56:55.408896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:56:55.409466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:56:55.410115 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:56:55.410605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:56:55.419251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:55.419403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 127/259] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:54 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:55.419806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:55.420305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:55.421205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:55.422298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:55.422788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:55.441157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Getting quotas for project 4c22ffb83d7d41828375606fcc6da53f. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:56:55.445213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Getting quotas for user afe98894d83f4678bb134782d90706e8 and project 4c22ffb83d7d41828375606fcc6da53f. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:56:55.458262 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:56:55.462555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:56:55.525443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b5433fad-7ded-427a-85f9-914f51caab03 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.061887 Oct 02 00:56:55.530222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 133/260] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 00:56:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:56:55.538257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4aa6d799-8326-4792-b4f4-9d7cec80bb8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:55.538867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4aa6d799-8326-4792-b4f4-9d7cec80bb8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:55.598662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4aa6d799-8326-4792-b4f4-9d7cec80bb8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:55.608852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4aa6d799-8326-4792-b4f4-9d7cec80bb8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1246 microversion: 2.1 time: 0.075087 Oct 02 00:56:55.609714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 128/261] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:55 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:55.989078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:55.989778 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:55.996117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:55.996594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:55.997028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:55.997714 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:55.998192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:55.998611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.178885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:56.195589 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:56.197244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:56.198604 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-80cce3f9-f954-42d2-9828-c7ed3010e56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.213632 Oct 02 00:56:56.199168 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 134/262] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:55 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:56.428542 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:56.429136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:56.435524 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:56.436290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:56.436719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.437946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:56.438421 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:56.438842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.578201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:56.585817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-470b75f0-193a-4303-8e9a-a0c7d83aeb4e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.161080 Oct 02 00:56:56.586419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 129/263] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:56 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:56.633444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:56.634084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:56.640810 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:56.641323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:56.641999 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.642725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:56.643179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:56.643601 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:56.704540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:56.712229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e58d9c2e-0b47-4d14-afae-79fe532e3e8d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1250 microversion: 2.1 time: 0.082502 Oct 02 00:56:56.712798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 135/264] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:56 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:57.225220 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:57.225910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:57.231956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.232458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.232946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:57.233703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.234910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.235346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:57.486051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.495940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.497706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.498920 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d4509e4-cece-4eba-9bec-060789ae0c7a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.277629 Oct 02 00:56:57.500064 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 130/265] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:57 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:57.608532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:57.609139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:57.615585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.616072 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.616505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:57.617194 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.617648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.618091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:57.735077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:57.735847 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:57.742697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.743197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.743939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:57.745641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:57.746272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:57.746843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:57.754837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.758323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:56:57.763301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b958a66e-e989-4ba8-b70d-156b3662b81b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.158565 Oct 02 00:56:57.764000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 136/266] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:57 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:57.811457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:57.821042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf65dfaa-8363-435e-a582-6218e2fd93c7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1298 microversion: 2.1 time: 0.090023 Oct 02 00:56:57.821613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 131/267] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:57 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:58.527771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:58.528395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:58.535549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.536323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.536960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.537860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.538629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.539279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.764830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:58.775457 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:58.777047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:58.778247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f8cb3424-2afa-4907-91c7-b4a6126f183f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.255086 Oct 02 00:56:58.778809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 137/268] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:58 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:58.786828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:58.787595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:58.794503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.795250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.796385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.796385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.796833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.797478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.843752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:58.844460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:58.851005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.851488 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.851917 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.852614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:58.853063 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:58.853483 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:58.950787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:58.959576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4fabb33b-a46b-41c3-8150-763c92d11268 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1304 microversion: 2.1 time: 0.119647 Oct 02 00:56:58.960336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 138/269] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:58 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:56:59.056972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:59.065272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e791534d-afb1-46d3-be48-08da92b0d747 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.282220 Oct 02 00:56:59.066037 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 132/270] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:58 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:56:59.808496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:59.809137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:59.815088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:59.815565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:59.815997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:59.816676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:59.817124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:59.817542 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:59.943415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:59.951520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:59.953506 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:56:59.954685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-50a46ccb-fcdb-4fa2-a8e1-d6c243113ef3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.150006 Oct 02 00:56:59.955250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 139/271] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:56:59 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:56:59.982961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:56:59.983596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:56:59.989968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:59.990418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:59.990850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:56:59.991538 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:56:59.991985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:56:59.992403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.092735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:00.094100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:00.100031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.100599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.101041 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.101740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.102231 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.102660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.120808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:00.129171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c2b772fe-e966-4bcb-9760-581cb9723129 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.150023 Oct 02 00:57:00.129743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 133/272] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:56:59 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:00.227131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:00.234845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-834bffe3-e70f-4f9b-a104-d4c802b2a6bf tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.145948 Oct 02 00:57:00.235421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 140/273] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:00 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:00.980234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:00.980764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:00.987294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.987830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.988202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:00.988893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:00.989347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:00.989769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:01.116625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.125382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.126857 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.127993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f83897af-ba3b-4716-bc03-b0005857fb4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.151753 Oct 02 00:57:01.128548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 134/274] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:00 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:57:01.152019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:01.152630 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:01.159039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:01.159517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:01.159955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:01.160638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:01.161090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:01.161513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:01.258550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:01.259288 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:01.265713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:01.266319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:01.266816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:01.267570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:01.268090 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:01.268544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:01.285319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.292928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d0878561-4980-4abf-b2bc-97c58372ad59 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.144648 Oct 02 00:57:01.293498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 141/275] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:01 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:01.395847 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:01.403468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-005a010b-4491-4cfb-a68a-2cd0431915a9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.148941 Oct 02 00:57:01.404024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 135/276] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:01 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:02.152592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:02.153228 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:02.159769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.160243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.160676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.161364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.161803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.162251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.293729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:02.302368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:02.303790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:02.304929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b841126f-bc18-4ee7-8b9e-36e628881bea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.156420 Oct 02 00:57:02.305482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 142/277] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:02 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:57:02.316252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:02.316889 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:02.323194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.323670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.324102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.324783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.325231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.325648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.426290 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:02.426913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:02.432817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.433305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.433731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.434461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:02.434919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:02.435337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:02.452600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:02.460474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57e991be-e6bb-473b-a9f3-63bee1e08ab6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.148636 Oct 02 00:57:02.468868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 136/278] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:02 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:02.578703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:02.587117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8a5012c6-81ae-4a0a-9777-d5a6646e8905 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.164652 Oct 02 00:57:02.587860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 143/279] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:02 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:03.330384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:03.330992 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:03.337532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.338012 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.338549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.339314 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.339768 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.340194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.344910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:03.469496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.477640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.479167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.480333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c8b3811-eb06-4559-bdc8-b055e9708845 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.154041 Oct 02 00:57:03.480893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 137/280] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:03 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:03.484828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:03.485521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:03.491390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.491872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.492302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.492989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.493438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.493860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.610779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:03.611638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:03.617457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.617936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.618047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.618516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.619206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:03.620005 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:03.620426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:03.625833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c1662650-21b2-4906-9acc-9d0b2daea8b0 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.144881 Oct 02 00:57:03.626507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 144/281] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:03 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:03.748519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:03.756048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c74bf721-c373-4a34-9c3d-32810c2e48d7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.149801 Oct 02 00:57:03.756604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 138/282] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:03 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:04.504776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:04.505376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:04.511643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.512132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.512644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.513461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.513949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.514505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.646454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.648981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:04.649593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:04.655070 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.656080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.656523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.656643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.656990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.657669 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9bfcbb6d-be1b-4d27-9e35-b51ee52773df tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.156846 Oct 02 00:57:04.657784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.658612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.658727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 145/283] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:04 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:04.658830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.779195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:04.779720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:04.785615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.786119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.786553 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.787240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:04.787405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.787687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:04.788104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:04.795062 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-012763e8-329e-44e2-bfcd-9e1eeac37035 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.149871 Oct 02 00:57:04.795623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 139/284] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:04 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:04.914120 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:04.921678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c114361f-1c7f-42de-a9b8-fe7b83bd7d46 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.146423 Oct 02 00:57:04.922266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 146/285] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:04 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:05.683451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:05.684058 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:05.686214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:05.693483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.694332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.694983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:05.695794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.696355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.696841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:05.819864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:05.820518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:05.822517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=4 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:05.823829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=16 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:05.829839 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.830566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.831185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:05.832095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.832740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.833347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:05.902336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:05.916115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:05.917758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:05.919023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-684e0cb7-578c-46ba-9c3e-4b0d940ce849 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.239433 Oct 02 00:57:05.920728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 140/286] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:05 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:05.945852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:05.946512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:05.953195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.953959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.954921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:05.956365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:05.956837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:05.957261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.037137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:06.054655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ccfac7cf-3494-4d26-8640-4c53bc05da8f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.237136 Oct 02 00:57:06.065143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 147/287] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:05 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:06.148566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:06.156923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68878e8c-5adc-4b9f-a45a-b9ff0fe75ee1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.215469 Oct 02 00:57:06.157517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 141/288] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:05 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:06.950700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:06.951891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:06.958940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.959423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.959876 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:06.960746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:06.961261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:06.961688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.083195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:07.083800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:07.089856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.090371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.090804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.091492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.091941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.092358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.271557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:07.281696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:07.283247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:07.284400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e7f35080-6e36-4b71-9900-bdff797bd5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.337516 Oct 02 00:57:07.284959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 148/289] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:06 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:07.295578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:07.296235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:07.302501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.302990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.303431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.304127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.304581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.305001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.338711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:07.347783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc7f626d-b674-497c-8710-62e2ce74446e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.268862 Oct 02 00:57:07.348435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 142/290] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:07 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:07.536367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:07.544026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5b2bd49b-40a6-4149-8823-15eb4b415dcb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.252920 Oct 02 00:57:07.544583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 149/291] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:07 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:07.774834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cf68f7f3-ae2f-4d6d-bc39-d1dc0c3815b2 req-068261e5-cbb4-42d0-895e-5ddd0c0bdaff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da4fee8-13b9-487e-9186-c19e804d060f", "tag": "bf081b2d-5f2b-4115-9adf-ffd4e6381758"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:07.784121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cf68f7f3-ae2f-4d6d-bc39-d1dc0c3815b2 req-068261e5-cbb4-42d0-895e-5ddd0c0bdaff service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:07.784598 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cf68f7f3-ae2f-4d6d-bc39-d1dc0c3815b2 req-068261e5-cbb4-42d0-895e-5ddd0c0bdaff service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:07.785057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cf68f7f3-ae2f-4d6d-bc39-d1dc0c3815b2 req-068261e5-cbb4-42d0-895e-5ddd0c0bdaff service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:07.795999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cf68f7f3-ae2f-4d6d-bc39-d1dc0c3815b2 req-068261e5-cbb4-42d0-895e-5ddd0c0bdaff service nova] Creating event network-changed:bf081b2d-5f2b-4115-9adf-ffd4e6381758 for instance 7da4fee8-13b9-487e-9186-c19e804d060f on hv-cinder-maste Oct 02 00:57:07.800787 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cf68f7f3-ae2f-4d6d-bc39-d1dc0c3815b2 req-068261e5-cbb4-42d0-895e-5ddd0c0bdaff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029555 Oct 02 00:57:07.801388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 143/292] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:08.309183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:08.310125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:08.317516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.318120 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.318758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.319456 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.319910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.320328 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.372801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:08.373500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:08.379724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.380210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.380756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.381446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.381894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.382337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.618738 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:08.638329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:08.638329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:08.638329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-093bf372-d9ec-4f07-80c4-261a405fd357 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1745 microversion: 2.20 time: 0.327395 Oct 02 00:57:08.638620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 150/293] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:08 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1745 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:08.648365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:08.648988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:08.653840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:08.656462 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.657399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.657399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:08.658091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:08.661645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1cd2cc81-e1e1-4608-a0ed-84db57ecf1cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.294488 Oct 02 00:57:08.662465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:08.662603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 144/294] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:08 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:08.666591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.112523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:09.121239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1fd2f5ea-4375-4444-b0fe-622c72921730 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.487037 Oct 02 00:57:09.121811 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 151/295] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:08 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:09.660406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:09.661017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:09.667389 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.667954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.668278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.668968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.669414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.669836 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.684679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:09.685443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:09.691746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.692252 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.692685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.693370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:09.693816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:09.694285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:09.863946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:09.875644 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:09.877251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:09.878539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce061a7f-49d7-4d1d-9cb5-12f181bcf943 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1745 microversion: 2.20 time: 0.222116 Oct 02 00:57:09.880188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 145/296] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:09 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:09.896224 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:09.904278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-edb08959-5bdd-4280-91f6-90c48f8a71ad tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.223407 Oct 02 00:57:09.905701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 152/297] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:09 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:10.144800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:10.145405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:10.151564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.151987 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.152419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.153106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.153560 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.153981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.286172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:10.293758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-69064afa-09b8-40df-aef5-f93d54638e56 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.152815 Oct 02 00:57:10.294350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 146/298] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:10 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:10.903961 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:10.905034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:10.911111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.911727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.912261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.913169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.913820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.914350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.927569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:10.928737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:10.935282 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:10.935464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.938547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.939000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:10.940453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:10.940928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:10.941366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.100650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:11.127733 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:11.129438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:11.133058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8dae0a15-7e11-4221-ba74-783cbb5e203b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1745 microversion: 2.20 time: 0.232836 Oct 02 00:57:11.134138 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 153/299] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:10 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1745 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:11.166214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:11.175952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75fa9ad1-cd5e-4631-af23-f60d07661047 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.252231 Oct 02 00:57:11.177532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 147/300] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:10 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:11.317249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:11.317814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:11.324009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.324497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.324932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.325627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:11.327291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:11.327291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:11.479624 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:11.488379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9892af65-5dff-4b40-8d1e-60e8a92dfe8d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.174944 Oct 02 00:57:11.488950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 154/301] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:11 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:12.158624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:12.159133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:12.169493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:12.170302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:12.171114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.172199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:12.172817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:12.173402 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.209798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:12.211731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:12.220039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:12.222526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:12.223509 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.224446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:12.226709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:12.227382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.465399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:12.477449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:12.478975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:12.480157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58e528ce-d5e9-4536-a32e-45dcaefe7e1b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.325771 Oct 02 00:57:12.487885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 148/302] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:12 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:12.495312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-50eb4b14-9d2b-4abe-8dbe-455135bbf067 req-750a177d-a311-421a-8b76-bc10f581adbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4241ee-1589-42f2-986e-abe5f0a2c369", "name": "network-vif-plugged", "status": "completed", "tag": "bb0e6fe9-481b-4e10-995c-f5411611262d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:12.525651 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-50eb4b14-9d2b-4abe-8dbe-455135bbf067 req-750a177d-a311-421a-8b76-bc10f581adbd service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:12.527401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-50eb4b14-9d2b-4abe-8dbe-455135bbf067 req-750a177d-a311-421a-8b76-bc10f581adbd service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:12.529749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-50eb4b14-9d2b-4abe-8dbe-455135bbf067 req-750a177d-a311-421a-8b76-bc10f581adbd service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.565593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-50eb4b14-9d2b-4abe-8dbe-455135bbf067 req-750a177d-a311-421a-8b76-bc10f581adbd service nova] Creating event network-vif-plugged:bb0e6fe9-481b-4e10-995c-f5411611262d for instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 on hv-cinder-maste Oct 02 00:57:12.579727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-50eb4b14-9d2b-4abe-8dbe-455135bbf067 req-750a177d-a311-421a-8b76-bc10f581adbd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087859 Oct 02 00:57:12.581896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 149/303] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:12.597423 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:12.598396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:12.613639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:12.614391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:12.616221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.616956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:12.617416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:12.620236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:12.628068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:12.636193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b75a7ddc-10ef-4730-a9a9-82631782c692 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.440639 Oct 02 00:57:12.639375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 155/304] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:12 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:12.818241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:12.826108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bec8935f-19bb-40b8-ac9e-3d05c9f5e685 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.241884 Oct 02 00:57:12.827198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 150/305] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:12 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:13.512537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:13.513084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:13.520475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.521401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.522095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.522867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.523545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.524138 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.683705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:13.685011 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:13.692367 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.693276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.693874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.694832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.695447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.696035 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.742700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:13.770418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:13.772746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:13.774010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-57f5f130-00eb-43c4-9325-f84cf0797146 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.265743 Oct 02 00:57:13.778486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 156/306] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:13 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:13.852929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:13.853922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:13.865688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.866510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.867188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.868124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:13.868788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:13.870347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:13.962054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:13.981480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08369b97-d138-46ee-a64f-b906145d2c3e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.299492 Oct 02 00:57:13.982304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 151/307] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:13 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:14.123023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:14.131889 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d462ffba-4223-44fd-9e65-54f26db06967 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.283526 Oct 02 00:57:14.140329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 157/308] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:13 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:14.600508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d027469f-e3b9-419a-a389-dcd417205c48 req-7de93df0-b62e-4a67-9a27-3415352c3856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb223bc-04ab-40a1-91da-3a3900ed7c11", "name": "network-vif-plugged", "status": "completed", "tag": "35dfa250-2a82-4094-bfb8-cf1ecf3f6a10"}, {"server_uuid": "7da4fee8-13b9-487e-9186-c19e804d060f", "name": "network-vif-plugged", "status": "completed", "tag": "bf081b2d-5f2b-4115-9adf-ffd4e6381758"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:14.615140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d027469f-e3b9-419a-a389-dcd417205c48 req-7de93df0-b62e-4a67-9a27-3415352c3856 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:14.616629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d027469f-e3b9-419a-a389-dcd417205c48 req-7de93df0-b62e-4a67-9a27-3415352c3856 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:14.617663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d027469f-e3b9-419a-a389-dcd417205c48 req-7de93df0-b62e-4a67-9a27-3415352c3856 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:14.633886 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d027469f-e3b9-419a-a389-dcd417205c48 req-7de93df0-b62e-4a67-9a27-3415352c3856 service nova] Creating event network-vif-plugged:35dfa250-2a82-4094-bfb8-cf1ecf3f6a10 for instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 on hv-cinder-maste Oct 02 00:57:14.634424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d027469f-e3b9-419a-a389-dcd417205c48 req-7de93df0-b62e-4a67-9a27-3415352c3856 service nova] Creating event network-vif-plugged:bf081b2d-5f2b-4115-9adf-ffd4e6381758 for instance 7da4fee8-13b9-487e-9186-c19e804d060f on hv-cinder-maste Oct 02 00:57:14.643514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d027469f-e3b9-419a-a389-dcd417205c48 req-7de93df0-b62e-4a67-9a27-3415352c3856 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047781 Oct 02 00:57:14.645157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 152/309] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:14.804569 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:14.805303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:14.812833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:14.814251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:14.815902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:14.817530 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:14.818339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:14.819373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:15.011727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:15.012448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:15.027242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:15.028247 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:15.029377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:15.030028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:15.030947 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:15.031570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:15.032142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:15.037256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:15.038761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:15.049557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bba32161-2540-4489-ad3f-b9d013528996 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.248915 Oct 02 00:57:15.050177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 158/310] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:14 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:15.164698 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:15.165400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:15.172948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:15.173780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:15.174452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:15.175386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:15.176112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:15.176773 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:15.334947 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:15.353026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-69ed14d0-84ca-408c-93a3-96875f0aa7ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.351338 Oct 02 00:57:15.367348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 153/311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:15 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:15.395492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:15.404142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-390fee47-867c-4853-8b77-90276349f949 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.243336 Oct 02 00:57:15.404658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 159/312] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:15 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:16.078937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:16.080402 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:16.087537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:16.088117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:16.088602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:16.089374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:16.089849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:16.090309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:16.248213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:16.257391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:16.259188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:16.260638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd3e0115-e892-4358-9fad-e2e859ecdbf7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.185637 Oct 02 00:57:16.261731 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 154/313] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:16 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:16.377001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:16.377594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:16.387744 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:16.388493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:16.389745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:16.391064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:16.391537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:16.391973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:16.426527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:16.427720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:16.435067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:16.435980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:16.436411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:16.437272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:16.437883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:16.438329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:16.611353 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:16.628856 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-561384f2-cd26-482a-86f6-a28388d1d582 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.255249 Oct 02 00:57:16.639277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 160/314] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:16 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:16.645962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:16.648670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:16.657888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c6c965a6-3644-493b-8167-f06e3ba5606d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1260 microversion: 2.1 time: 0.233798 Oct 02 00:57:16.666564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 155/315] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:16 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:17.289993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:17.290834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:17.298698 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.299248 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.299753 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.300532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.301097 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.301761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.463586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:17.472978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:17.474448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:17.475806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b17d84cb-cab6-445e-8094-4279a409d6f9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.190257 Oct 02 00:57:17.476673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 161/316] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:17 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:57:17.665888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:17.666680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:17.673881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.674633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.675068 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.675768 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.676222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.676645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.690753 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:17.691817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:17.707151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.707897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.708509 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:17.709388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:17.710006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:17.710632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:18.041332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:18.052109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:18.055706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57939064-5391-4c68-a15c-1866b3e85c69 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1371 microversion: 2.1 time: 0.394002 Oct 02 00:57:18.072786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 156/317] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:17 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:18.077051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-27e22af8-4a99-495d-918c-c6f9f259d3bd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1443 microversion: 2.1 time: 0.390604 Oct 02 00:57:18.077654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 162/318] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:17 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1443 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:18.103436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:18.104166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:18.114441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:18.114936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:18.117608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:18.118805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:18.121383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:18.121968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:18.305041 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:18.315128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0cd53e79-dd97-4e1f-83c0-d1c815ce8755 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1443 microversion: 2.1 time: 0.215690 Oct 02 00:57:18.330095 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 157/319] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:18 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1443 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:18.502823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:18.503435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:18.516706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:18.517464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:18.518217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:18.519649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:18.520638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:18.521225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:18.739221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:18.753343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:18.759301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:18.760991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8f0355cc-7b38-4a7e-972a-c6fa98d0a0be tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.262062 Oct 02 00:57:18.763234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 163/320] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:18 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:19.083517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:19.085040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:19.091352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=86 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:19.093851 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.094532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.095267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.096237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.097029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.097632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.413417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:19.422153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c2ac3521-a221-4539-8b5a-8c5225673283 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1566 microversion: 2.1 time: 0.344724 Oct 02 00:57:19.438919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 158/321] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:19 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1566 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:19.446334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d18634d9-066e-4e7f-abb7-f5fee6b467c6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:19.446866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d18634d9-066e-4e7f-abb7-f5fee6b467c6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:19.455504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d18634d9-066e-4e7f-abb7-f5fee6b467c6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.455998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d18634d9-066e-4e7f-abb7-f5fee6b467c6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.456434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d18634d9-066e-4e7f-abb7-f5fee6b467c6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.458110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d18634d9-066e-4e7f-abb7-f5fee6b467c6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.458559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d18634d9-066e-4e7f-abb7-f5fee6b467c6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.458989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d18634d9-066e-4e7f-abb7-f5fee6b467c6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.603635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d18634d9-066e-4e7f-abb7-f5fee6b467c6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161211 Oct 02 00:57:19.604244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 164/322] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Oct 2 00:57:19 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:19.787991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:19.788610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:19.796797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.797214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.803151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:19.804117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:19.804908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:19.805497 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:20.219764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:20.231534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:20.233558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:20.235257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f8160e6f-d1b2-4f2f-b914-9486d815220b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.451308 Oct 02 00:57:20.235349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 159/323] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:19 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:21.003077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-5a37dcde-92a4-473d-81fa-b5023a1b2176 req-668e2b19-8d18-44f3-8144-0861a7183989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da4fee8-13b9-487e-9186-c19e804d060f", "tag": "bf081b2d-5f2b-4115-9adf-ffd4e6381758"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:21.015131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:21.017831 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5a37dcde-92a4-473d-81fa-b5023a1b2176 req-668e2b19-8d18-44f3-8144-0861a7183989 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:21.018591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5a37dcde-92a4-473d-81fa-b5023a1b2176 req-668e2b19-8d18-44f3-8144-0861a7183989 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:21.019454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5a37dcde-92a4-473d-81fa-b5023a1b2176 req-668e2b19-8d18-44f3-8144-0861a7183989 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:21.053233 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-5a37dcde-92a4-473d-81fa-b5023a1b2176 req-668e2b19-8d18-44f3-8144-0861a7183989 service nova] Creating event network-changed:bf081b2d-5f2b-4115-9adf-ffd4e6381758 for instance 7da4fee8-13b9-487e-9186-c19e804d060f on hv-cinder-maste Oct 02 00:57:21.060612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-5a37dcde-92a4-473d-81fa-b5023a1b2176 req-668e2b19-8d18-44f3-8144-0861a7183989 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061635 Oct 02 00:57:21.062010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 165/324] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:21.260896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:21.262182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:21.269226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:21.270025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:21.270751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:21.271696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:21.272390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:21.273054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:21.484228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:21.493611 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:21.502369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:21.503897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c44ec644-d987-47db-9f8a-e0417f5c47b6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.246986 Oct 02 00:57:21.505004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 160/325] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:21 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:21.591675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-113861790", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:21.658835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] validate_networks() for None {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:57:22.111949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c6a3f5d6-9537-4cc4-8852-aabafabeb409 req-f8fec286-bccf-4f74-834a-57c3db854166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb223bc-04ab-40a1-91da-3a3900ed7c11", "tag": "35dfa250-2a82-4094-bfb8-cf1ecf3f6a10"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:22.130361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c6a3f5d6-9537-4cc4-8852-aabafabeb409 req-f8fec286-bccf-4f74-834a-57c3db854166 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:22.130842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c6a3f5d6-9537-4cc4-8852-aabafabeb409 req-f8fec286-bccf-4f74-834a-57c3db854166 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:22.131269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c6a3f5d6-9537-4cc4-8852-aabafabeb409 req-f8fec286-bccf-4f74-834a-57c3db854166 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.161133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c6a3f5d6-9537-4cc4-8852-aabafabeb409 req-f8fec286-bccf-4f74-834a-57c3db854166 service nova] Creating event network-changed:35dfa250-2a82-4094-bfb8-cf1ecf3f6a10 for instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 on hv-cinder-maste Oct 02 00:57:22.175411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c6a3f5d6-9537-4cc4-8852-aabafabeb409 req-f8fec286-bccf-4f74-834a-57c3db854166 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069446 Oct 02 00:57:22.176418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 161/326] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:22.340997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:57:22.343819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:57:22.345047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:57:22.348533 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:57:22.350249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:57:22.404287 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:22.405305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:22.405911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.409038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:22.409756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:22.410482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.433547 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Getting quotas for project b9e459b5a81b45e8aebe4c2409f277d0. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:57:22.439091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Getting quotas for user 24cf2d48f18841128e89bf3bea9bbf5c and project b9e459b5a81b45e8aebe4c2409f277d0. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:57:22.454004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:57:22.456939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:57:22.545956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:22.546761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:22.558156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-58ed8280-28d2-42e5-96be-6242b7930567 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971054 Oct 02 00:57:22.560148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:22.561265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:22.561717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.565761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 166/327] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 00:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:57:22.565910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:22.566359 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:22.566795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:22.570592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3c72b158-2122-4bbe-968c-0199615cd100 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:22.571202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3c72b158-2122-4bbe-968c-0199615cd100 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:22.759615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3c72b158-2122-4bbe-968c-0199615cd100 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:22.768264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3c72b158-2122-4bbe-968c-0199615cd100 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1214 microversion: 2.1 time: 0.201299 Oct 02 00:57:22.773275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 167/328] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:22 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:22.990534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:23.012292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:23.013638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:23.016037 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11c38896-821d-4850-a613-804d21baf1c4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.475307 Oct 02 00:57:23.018544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 162/329] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:22 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:57:23.799781 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:23.800387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:23.806822 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:23.807285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:23.807718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:23.808433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:23.808901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:23.809306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:23.871311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:23.879211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ac9888df-e324-4c51-84f2-71200abdb9a0 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1266 microversion: 2.1 time: 0.083200 Oct 02 00:57:23.880105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 168/330] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:23 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:24.043961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:24.044564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:24.051030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.051508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.051936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.052611 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.053058 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.053477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.182335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:24.191077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:24.192723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:24.194835 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bf0b81e-2ddf-4fe8-a018-1c6ce290c35f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1740 microversion: 2.20 time: 0.154002 Oct 02 00:57:24.195603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 163/331] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:24 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:24.904506 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:24.905769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:24.912381 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.913148 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.913760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:24.914797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:24.915411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:24.915995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.012849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be1979d1-3239-48f0-9036-889eb5fd95cb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:25.013344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be1979d1-3239-48f0-9036-889eb5fd95cb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:25.020186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1979d1-3239-48f0-9036-889eb5fd95cb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:25.020686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1979d1-3239-48f0-9036-889eb5fd95cb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:25.021102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1979d1-3239-48f0-9036-889eb5fd95cb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.022006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1979d1-3239-48f0-9036-889eb5fd95cb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:25.022486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1979d1-3239-48f0-9036-889eb5fd95cb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:25.022905 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1979d1-3239-48f0-9036-889eb5fd95cb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.047245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be1979d1-3239-48f0-9036-889eb5fd95cb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/ips" status: 200 len: 145 microversion: 2.1 time: 0.038424 Oct 02 00:57:25.048553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 164/332] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 00:57:25 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:25.168858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:25.177214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-25897b63-6e0a-45ad-a7fd-8b859a5f9f86 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1284 microversion: 2.1 time: 0.278419 Oct 02 00:57:25.190083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 169/333] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:24 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:25.223859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:25.224472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:25.230839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:25.231326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:25.231758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.232455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:25.232914 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:25.233341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:25.518294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:25.526477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:25.527904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:25.529033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c07a4c8-b961-49b2-874d-123ae9c335c9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1722 microversion: 2.20 time: 0.309206 Oct 02 00:57:25.530207 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 165/334] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:25 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:26.199599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:26.200464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:26.207883 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.208462 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.208959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.209794 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.210517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.211051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.347876 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:26.355495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-92830831-d13f-4805-88eb-b2e2dc883e5b tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1314 microversion: 2.1 time: 0.159726 Oct 02 00:57:26.356064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 170/335] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:26 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:26.554956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:26.555627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:26.562190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.562678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.563121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.563812 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:26.564271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:26.564696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:26.705650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:26.713972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:26.715454 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:26.716595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd3aea2a-1070-411a-a423-8f5491f5b18b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1722 microversion: 2.20 time: 0.165525 Oct 02 00:57:26.717201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 166/336] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:26 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:27.378742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:27.379306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:27.385191 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:27.385682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:27.386147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:27.386844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:27.387302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:27.387728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:27.518107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:27.526198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9b45c0b4-8288-4db3-94b6-4a8243318170 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1314 microversion: 2.1 time: 0.151407 Oct 02 00:57:27.526757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 171/337] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:27 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:27.744659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:27.745923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:27.752563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:27.753057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:27.753499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:27.754247 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:27.754868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:27.755513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:27.946411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-77461678-0b52-4119-8869-5c8950f7b713 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b8cba92-1532-4ecd-b334-779c92f7624a"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:27.948899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-77461678-0b52-4119-8869-5c8950f7b713 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:27.956269 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77461678-0b52-4119-8869-5c8950f7b713 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:27.956910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77461678-0b52-4119-8869-5c8950f7b713 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:27.957794 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77461678-0b52-4119-8869-5c8950f7b713 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:27.958611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77461678-0b52-4119-8869-5c8950f7b713 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:27.959211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77461678-0b52-4119-8869-5c8950f7b713 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:27.959658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77461678-0b52-4119-8869-5c8950f7b713 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:27.963818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:27.974725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:27.976387 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:27.979931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac8ea9fb-3cbb-4f74-8ceb-e9837ec33936 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1722 microversion: 2.20 time: 0.238430 Oct 02 00:57:28.004911 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 167/338] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:27 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:28.047111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:28.151393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3c18cab9-3f55-4a2d-944a-d196cdb694b0 req-63b4fbc9-21bd-407a-a3c0-f4118ffec180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4241ee-1589-42f2-986e-abe5f0a2c369", "name": "network-vif-unplugged", "status": "completed", "tag": "bb0e6fe9-481b-4e10-995c-f5411611262d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:28.174228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3c18cab9-3f55-4a2d-944a-d196cdb694b0 req-63b4fbc9-21bd-407a-a3c0-f4118ffec180 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.174893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3c18cab9-3f55-4a2d-944a-d196cdb694b0 req-63b4fbc9-21bd-407a-a3c0-f4118ffec180 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.175555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3c18cab9-3f55-4a2d-944a-d196cdb694b0 req-63b4fbc9-21bd-407a-a3c0-f4118ffec180 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:28.189684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3c18cab9-3f55-4a2d-944a-d196cdb694b0 req-63b4fbc9-21bd-407a-a3c0-f4118ffec180 service nova] Creating event network-vif-unplugged:bb0e6fe9-481b-4e10-995c-f5411611262d for instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 on hv-cinder-maste Oct 02 00:57:28.195702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3c18cab9-3f55-4a2d-944a-d196cdb694b0 req-63b4fbc9-21bd-407a-a3c0-f4118ffec180 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053570 Oct 02 00:57:28.196902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 168/339] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:28.316335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-77461678-0b52-4119-8869-5c8950f7b713 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374178 Oct 02 00:57:28.322328 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 172/340] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 00:57:27 2022] POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:28.354479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3a512264-657e-4d06-9f02-446648c2494b req-847193bb-27cf-4f64-8d6a-2a0370cf237e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e787bba1-d46e-4b3f-b341-849eefb4829e", "tag": "fbc9e1d3-60f0-413e-ba53-9a7e1666613b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:28.364448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a512264-657e-4d06-9f02-446648c2494b req-847193bb-27cf-4f64-8d6a-2a0370cf237e service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.364926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a512264-657e-4d06-9f02-446648c2494b req-847193bb-27cf-4f64-8d6a-2a0370cf237e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.365354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a512264-657e-4d06-9f02-446648c2494b req-847193bb-27cf-4f64-8d6a-2a0370cf237e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:28.376345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3a512264-657e-4d06-9f02-446648c2494b req-847193bb-27cf-4f64-8d6a-2a0370cf237e service nova] Creating event network-changed:fbc9e1d3-60f0-413e-ba53-9a7e1666613b for instance e787bba1-d46e-4b3f-b341-849eefb4829e on hv-cinder-maste Oct 02 00:57:28.381221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3a512264-657e-4d06-9f02-446648c2494b req-847193bb-27cf-4f64-8d6a-2a0370cf237e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031431 Oct 02 00:57:28.381980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 169/341] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:28.550037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:28.550750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:28.557003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.557771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.558245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:28.558954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:28.559398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:28.559818 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:28.731992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:28.740552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-66fa6931-87a6-4c8e-8b2c-388466224b6d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1314 microversion: 2.1 time: 0.195127 Oct 02 00:57:28.741268 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 173/342] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:28 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:29.006824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:29.007511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:29.013609 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.014112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.014544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.015254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.015709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.016130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.240414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:29.249331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:29.250806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:29.251939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e82b2ded-494f-423c-9182-ffebf7ad8d74 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1665 microversion: 2.20 time: 0.249813 Oct 02 00:57:29.252487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 170/343] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:29 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1665 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:29.276330 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ca65a2a1-6588-4065-b5cc-04404a2d2c21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd075850-e7df-4ab5-96d3-306918a5a503"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:29.278911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ca65a2a1-6588-4065-b5cc-04404a2d2c21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:29.285273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca65a2a1-6588-4065-b5cc-04404a2d2c21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.285750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca65a2a1-6588-4065-b5cc-04404a2d2c21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.286233 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca65a2a1-6588-4065-b5cc-04404a2d2c21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.286919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca65a2a1-6588-4065-b5cc-04404a2d2c21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.287369 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca65a2a1-6588-4065-b5cc-04404a2d2c21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.287797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ca65a2a1-6588-4065-b5cc-04404a2d2c21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.618432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ca65a2a1-6588-4065-b5cc-04404a2d2c21 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346158 Oct 02 00:57:29.619050 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 174/344] 10.222.0.25 () {62 vars in 1364 bytes} [Sun Oct 2 00:57:29 2022] POST /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments => generated 188 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:57:29.745177 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:29.745784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:29.751688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.752149 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.752580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.753260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.753733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.754183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.765425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:29.765982 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:29.771990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.772472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.773026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.773729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.774265 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.774694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.798054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120425) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 00:57:29.883125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e78c59d-a0dd-4ebc-be98-346284693463 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/action" status: 202 len: 0 microversion: 2.20 time: 0.142056 Oct 02 00:57:29.883974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 171/345] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Oct 2 00:57:29 2022] POST /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 02 00:57:29.892805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:29.893722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:29.901493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.901997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.902465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:29.903498 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:29.904114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:29.905053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:30.108814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:30.117707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:30.119353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:30.120665 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7db2041-2eba-415d-9a20-14a60bafaa06 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1751 microversion: 2.20 time: 0.232843 Oct 02 00:57:30.121227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 172/346] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:29 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1751 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:57:30.121973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:30.132416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a016571a-4e1c-43be-b728-b3a6e8f6b703 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1314 microversion: 2.1 time: 0.371344 Oct 02 00:57:30.141805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 175/347] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:29 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:31.147040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:31.148033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:31.154449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:31.154928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:31.155375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:31.156039 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:31.156483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:31.156897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:31.221782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:31.222427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:31.228792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:31.229276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:31.229713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:31.230440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:31.230895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:31.231319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:31.313596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:31.315951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:31.323729 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:31.325127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:31.326309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65d98b44-f6f3-4328-a6f6-30fc70fbc169 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1753 microversion: 2.20 time: 0.183269 Oct 02 00:57:31.326876 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 173/348] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:31 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:31.374988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:31.382985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c89ac7c7-d9a8-4fb7-848d-0bf228467470 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1314 microversion: 2.1 time: 0.165022 Oct 02 00:57:31.383542 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 176/349] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:31 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:32.352200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:32.352799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:32.360099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:32.360576 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:32.361007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:32.361688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:32.362173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:32.362621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:32.404458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:32.405064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:32.411336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:32.411817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:32.412281 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:32.412974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:32.413423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:32.413842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:32.428397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:32.539263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:32.548091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:32.549725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:32.551032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0cffe1da-f20b-4bc6-967e-fff6979f5999 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1753 microversion: 2.20 time: 0.203342 Oct 02 00:57:32.551679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 174/350] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:32 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:32.574560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:32.583146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-abd810fc-9e31-47a2-918c-6bee0663578d tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1314 microversion: 2.1 time: 0.182395 Oct 02 00:57:32.583715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 177/351] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:32 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:33.576844 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:33.577364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:33.584011 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.584536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.584992 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.585706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.586186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.586616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.606086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:33.606701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:33.609049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=8 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:33.614867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.615354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.615791 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.616513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:33.616997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:33.617452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:33.784254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:33.790887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:33.793885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:33.795847 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:33.796986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-06d0e035-1041-41ad-9ac0-c3187cce4bc2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1753 microversion: 2.20 time: 0.224157 Oct 02 00:57:33.797698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 175/352] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:33 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:33.798985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1e3e5fd9-c91b-4a7d-ad60-f3badefafdbb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1314 microversion: 2.1 time: 0.196729 Oct 02 00:57:33.799532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 178/353] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:33 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:34.159346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-229267db-2f27-425e-bd77-cadc0aa3cbc1 req-5de88346-1bf2-4ff9-8f45-6d9b60a1142c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e787bba1-d46e-4b3f-b341-849eefb4829e", "name": "network-vif-plugged", "status": "completed", "tag": "fbc9e1d3-60f0-413e-ba53-9a7e1666613b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:34.170266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-229267db-2f27-425e-bd77-cadc0aa3cbc1 req-5de88346-1bf2-4ff9-8f45-6d9b60a1142c service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:34.170790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-229267db-2f27-425e-bd77-cadc0aa3cbc1 req-5de88346-1bf2-4ff9-8f45-6d9b60a1142c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:34.171224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-229267db-2f27-425e-bd77-cadc0aa3cbc1 req-5de88346-1bf2-4ff9-8f45-6d9b60a1142c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:34.182246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-229267db-2f27-425e-bd77-cadc0aa3cbc1 req-5de88346-1bf2-4ff9-8f45-6d9b60a1142c service nova] Creating event network-vif-plugged:fbc9e1d3-60f0-413e-ba53-9a7e1666613b for instance e787bba1-d46e-4b3f-b341-849eefb4829e on hv-cinder-maste Oct 02 00:57:34.186998 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-229267db-2f27-425e-bd77-cadc0aa3cbc1 req-5de88346-1bf2-4ff9-8f45-6d9b60a1142c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031278 Oct 02 00:57:34.187791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 176/354] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:57:34.820779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:34.821392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:34.823479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:34.824167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:34.828433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:34.828918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:34.829359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:34.830071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:34.830533 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:34.830747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:34.830962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:34.831222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:34.831648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:34.832325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:34.832781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:34.833199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:35.014783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:35.021451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:35.023395 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:35.024845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:35.026006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05cdf2fc-fdf7-4496-8a7b-1599f441f9a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1753 microversion: 2.20 time: 0.207785 Oct 02 00:57:35.026598 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 177/355] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:34 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:57:35.029432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7e96a6ae-26d6-47e5-ad30-dfd6d78e60e5 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1314 microversion: 2.1 time: 0.212362 Oct 02 00:57:35.029990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 179/356] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:34 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:36.051434 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:36.052044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:36.052654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:36.053666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:36.058649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.059133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.059571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.060863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.061108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.061314 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.061594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.061738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.062345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.063044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:36.063503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:36.063929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:36.251769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:36.255550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:36.264336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:36.264554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-07260cea-6271-423d-a7fe-7d9e157e9413 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1314 microversion: 2.1 time: 0.215687 Oct 02 00:57:36.265111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 180/357] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:36 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:36.265789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:36.266971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-957717b2-cadf-46b1-a1f6-abab38cac85b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1753 microversion: 2.20 time: 0.219428 Oct 02 00:57:36.267520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 178/358] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:36 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1753 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:37.287855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:37.288481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:37.291967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:37.292576 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:37.295493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.296370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.297042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.297836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.298397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.298888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.299013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.299441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.299876 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.300571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.301319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.301910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.490441 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:37.494282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:37.498432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-762617d3-97e5-46da-81fb-90006d479292 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1464 microversion: 2.1 time: 0.214701 Oct 02 00:57:37.499002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 181/359] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:37 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1464 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:37.503758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:37.505237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:37.506405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d51550f3-1206-40ea-8439-0149da45a5ab tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1753 microversion: 2.20 time: 0.218837 Oct 02 00:57:37.506945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 179/360] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:37 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1753 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:37.545257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:37.545715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:37.551639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.552125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.552564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.553257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.553716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.554175 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.580495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:57:37.653443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-02d2d466-4e88-405a-ab47-3fdcdc38b196 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 204 len: 0 microversion: 2.1 time: 0.111592 Oct 02 00:57:37.654273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 182/361] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 00:57:37 2022] DELETE /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:57:37.662569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:37.663178 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:37.669062 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.669579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.670010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.670735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.671191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.671617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:37.798566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:37.807273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f5b00b96-3352-48b7-937f-0305b8056230 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1470 microversion: 2.1 time: 0.148340 Oct 02 00:57:37.808288 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 180/362] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:37 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:37.987216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5dfcdad5-008a-4b47-a201-37a57cf2e142 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:37.993144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5dfcdad5-008a-4b47-a201-37a57cf2e142 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:37.993629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5dfcdad5-008a-4b47-a201-37a57cf2e142 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:37.994419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5dfcdad5-008a-4b47-a201-37a57cf2e142 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.055212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5dfcdad5-008a-4b47-a201-37a57cf2e142 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Going to try to stop instance {{(pid=120424) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 00:57:38.059736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:38.098208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5dfcdad5-008a-4b47-a201-37a57cf2e142 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/action" status: 202 len: 0 microversion: 2.1 time: 0.115079 Oct 02 00:57:38.098804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 183/363] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:57:37 2022] POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:57:38.106915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:38.107697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:38.113917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.114420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.114853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.115547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.116001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.116427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.247365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:38.255556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-13e77154-d44a-4e3f-8c57-7ba26f0cc593 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.152535 Oct 02 00:57:38.256119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 181/364] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:38 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:38.532213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:38.532914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:38.540076 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.540566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.541029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.541717 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.542198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.542622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.670351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:38.678832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:38.680279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:38.681433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5da7e03f-6519-4ae2-bb2c-414e1b41de38 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1753 microversion: 2.20 time: 0.154004 Oct 02 00:57:38.681990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 184/365] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:38 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:38.832063 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:38.832665 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:38.839216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.839718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.840137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.840824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:38.841286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:38.841712 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:38.964700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:38.972359 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78cde32a-a771-40cd-8ce1-f62536b9257f tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1470 microversion: 2.1 time: 0.144603 Oct 02 00:57:38.972921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 182/366] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:38 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1470 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:39.280014 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:39.280679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:39.287659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:39.288143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:39.288584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:39.289302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:39.289754 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:39.290201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:39.425742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:39.434119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f4de45d7-8e1f-4928-b808-da114ed6aecc tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.158572 Oct 02 00:57:39.434689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 185/367] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:39 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:39.717114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:39.717645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:39.723481 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:39.723956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:39.724388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:39.725068 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:39.725516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:39.725937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:39.885279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:39.895104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:39.896549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:39.897714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-28f8fa90-dd31-43b5-9b6e-191c973213eb tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1753 microversion: 2.20 time: 0.185174 Oct 02 00:57:39.898301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 183/368] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:39 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:39.995841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:39.996552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:40.003239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.003719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.004156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:40.004844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.005297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.005718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:40.444652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:40.452682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-682e8b9f-ca09-41c9-970d-ea2b3a43b9e6 tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1470 microversion: 2.1 time: 0.460746 Oct 02 00:57:40.453471 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 186/369] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:39 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:40.469756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:40.472492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:40.478441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.478928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.479369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:40.480068 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.480519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.480945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:40.742905 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-7e771b1b-caa6-477a-a5f9-120e05923efa req-b1f5d0f0-be97-4154-aae9-0967e2995e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e787bba1-d46e-4b3f-b341-849eefb4829e", "name": "network-vif-deleted", "tag": "fbc9e1d3-60f0-413e-ba53-9a7e1666613b"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:40.766739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:40.768338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7e771b1b-caa6-477a-a5f9-120e05923efa req-b1f5d0f0-be97-4154-aae9-0967e2995e37 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.768817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7e771b1b-caa6-477a-a5f9-120e05923efa req-b1f5d0f0-be97-4154-aae9-0967e2995e37 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.769250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7e771b1b-caa6-477a-a5f9-120e05923efa req-b1f5d0f0-be97-4154-aae9-0967e2995e37 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:40.774999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a57da872-4f8f-4d7a-8eca-70d4246eb7cf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.322144 Oct 02 00:57:40.775566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 184/370] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:40 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:40.782657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-7e771b1b-caa6-477a-a5f9-120e05923efa req-b1f5d0f0-be97-4154-aae9-0967e2995e37 service nova] Creating event network-vif-deleted:fbc9e1d3-60f0-413e-ba53-9a7e1666613b for instance e787bba1-d46e-4b3f-b341-849eefb4829e on hv-cinder-maste Oct 02 00:57:40.791528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-7e771b1b-caa6-477a-a5f9-120e05923efa req-b1f5d0f0-be97-4154-aae9-0967e2995e37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053651 Oct 02 00:57:40.792574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 187/371] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:57:40.923583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:40.924764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:40.931467 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.931987 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.932418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:40.933113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:40.933563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:40.933989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:41.126749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:41.135794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:41.137333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:41.139097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31f090ca-7b2b-4b98-91cd-fc34d1772a67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.220162 Oct 02 00:57:41.139636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 185/372] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:40 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:41.479243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:41.479968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:41.487412 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:41.487886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:41.488318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:41.489003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:41.489453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:41.489873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:41.519299 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:41.519771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:41.520202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:41.520639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lazy-loading 'fault' on Instance uuid e787bba1-d46e-4b3f-b341-849eefb4829e {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:57:41.564813 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cf2d48f18841128e89bf3bea9bbf5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e459b5a81b45e8aebe4c2409f277d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:41.573205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d390de81-9f47-44f4-aaad-b2d40de450ab tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 200 len: 1304 microversion: 2.1 time: 0.098029 Oct 02 00:57:41.573703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 188/373] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:41 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:41.798968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:41.799580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:41.805489 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:41.805969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:41.806448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:41.807132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:41.807587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:41.808038 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:41.937904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:41.947097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9b6c363-343f-4349-a993-a452c541b231 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.151972 Oct 02 00:57:41.947669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 186/374] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:41 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:42.164675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:42.165390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:42.171432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:42.171908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:42.172438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:42.173422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:42.173875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:42.174317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:42.351184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:42.362477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:42.364167 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:42.365590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-536c2a49-50af-4b51-bf29-757e1acaf913 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.204715 Oct 02 00:57:42.377394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 189/375] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:42 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:42.595945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:42.596560 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] [instance: e787bba1-d46e-4b3f-b341-849eefb4829e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:42.602669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:42.603162 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:42.603601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:42.604292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:42.604809 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:42.605277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:42.619761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] HTTP exception thrown: Instance e787bba1-d46e-4b3f-b341-849eefb4829e could not be found. Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Request method failure captured: Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e HTTP/1.1 Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOHvYkUCkQOT1iw-RiY6ldm3M9ZQsu-wegMhl51tkJYlXVIr4bUhaU7hg9BA6j8XiIFRkmwQHA-reno3yXBqBXe2fFxRmV4_zocb0Aq0po6vsmSsD-ZWpejAnMeI3xRJfsfLE6oIfAVep_2cbfANNYkolfGlf0880UsQA6Lppsd3kic Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: b9e459b5a81b45e8aebe4c2409f277d0 Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-1517356031 Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 00:57:42.621413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9e459b5a81b45e8aebe4c2409f277d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b9e459b5a81b45e8aebe4c2409f277d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b9e459b5a81b45e8aebe4c2409f277d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9e459b5a81b45e8aebe4c2409f277d0"}]}] Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-1517356031 Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: b9e459b5a81b45e8aebe4c2409f277d0 Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-1517356031 Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-1517356031-project Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 24cf2d48f18841128e89bf3bea9bbf5c Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-1517356031-project Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance e787bba1-d46e-4b3f-b341-849eefb4829e could not be found. Oct 02 00:57:42.622897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': 'e787bba1-d46e-4b3f-b341-849eefb4829e'} Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e787bba1-d46e-4b3f-b341-849eefb4829e could not be found. Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:57:42.623949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e787bba1-d46e-4b3f-b341-849eefb4829e could not be found. Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e787bba1-d46e-4b3f-b341-849eefb4829e could not be found. Oct 02 00:57:42.625659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:57:42.627684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] Returning 404 to user: Instance e787bba1-d46e-4b3f-b341-849eefb4829e could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:57:42.627684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18dab08d-5eed-42bb-9f3d-80701da835fb tempest-VolumesNegativeTest-1517356031 tempest-VolumesNegativeTest-1517356031-project] 10.222.0.25 "GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e" status: 404 len: 111 microversion: 2.1 time: 0.030830 Oct 02 00:57:42.629165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 187/376] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:42 2022] GET /compute/v2.1/servers/e787bba1-d46e-4b3f-b341-849eefb4829e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:57:42.972363 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:42.973777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:42.983377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:42.984182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:42.984931 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:42.985795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:42.986764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:42.987895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:43.170514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:43.179564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d21472fe-3cdc-4d84-93d8-45b55468173c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.211019 Oct 02 00:57:43.180449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 190/377] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:42 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:43.396354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:43.397251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:43.407745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:43.415469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:43.416034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:43.416853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:43.417403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:43.417904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:43.592151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:43.608504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:43.610657 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:43.611822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8260d449-b607-43d8-b4de-55cf612f61a3 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.220371 Oct 02 00:57:43.612365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 188/378] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:43 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:44.204375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:44.204873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:44.212015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:44.212574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:44.212967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:44.213673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:44.214299 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:44.218231 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:44.393784 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:44.403893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8ccf8257-e744-4c45-83e6-9f67852d230c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.203454 Oct 02 00:57:44.420048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 191/379] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:44 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:44.637206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:44.638023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:44.645599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:44.646112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:44.646555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:44.647357 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:44.647900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:44.648326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:44.823769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:44.846383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:44.847873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:44.849015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86992ca2-cc1a-455f-aa72-9c648f4d5617 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.216299 Oct 02 00:57:44.849926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 189/380] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:44 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:45.431446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:45.432757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:45.443905 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:45.445775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:45.446341 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:45.447137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:45.447671 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:45.448220 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:45.638774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:45.648559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0de435ee-68ac-46e8-8e9b-37ea1ce40805 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.225374 Oct 02 00:57:45.649421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 192/381] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:45 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:45.874497 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:45.875101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:45.882047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:45.882559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:45.882997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:45.883766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:45.884228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:45.884655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:46.039104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:46.048837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:46.050985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:46.051469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a075bac4-df14-44ec-890b-e7055e0b3500 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.180853 Oct 02 00:57:46.052189 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 190/382] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:45 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:46.686345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:46.686991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:46.701187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:46.702117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:46.702880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:46.703837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:46.704525 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:46.705142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:46.850555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:46.859617 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-af61ceb6-28b1-4930-9668-21c3e6af379d tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.178649 Oct 02 00:57:46.871569 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 193/383] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:46 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:47.079405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:47.080276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:47.089739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:47.091314 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:47.092062 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:47.093073 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:47.093830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:47.094621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:47.286815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:47.287576 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:47.297408 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:47.298895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:47.300086 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c584854-e071-48b1-83c0-47094de77353 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.225212 Oct 02 00:57:47.314457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 191/384] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:47 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:47.884071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:47.885516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:47.893202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:47.893697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:47.894168 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:47.894880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:47.895347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:47.895779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:48.043084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:48.048983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aef53865-1ff6-4bcd-b9f8-5918b2725246 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.168859 Oct 02 00:57:48.049656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 194/385] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:47 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:48.330975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:48.332426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:48.339733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:48.340329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:48.341125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:48.342098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:48.342621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:48.343131 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:48.487001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:48.501405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:48.502977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:48.504282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce7a0b2f-3aeb-48da-95cb-08d746670d69 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.177435 Oct 02 00:57:48.504982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 192/386] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:48 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:49.073593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:49.074230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:49.082545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:49.083221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:49.084016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:49.085082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:49.086726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:49.088583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:49.230805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:49.239351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c917d563-186b-4bb2-966a-2b8f9acc2cea tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.169966 Oct 02 00:57:49.240750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 195/387] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:49 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:49.531255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:49.531887 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:49.534202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:49.538974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:49.539540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:49.540156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:49.541033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:49.541668 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:49.542117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:49.688465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:49.699192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:49.701836 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:49.703723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9bb17b6f-5132-4556-8db9-a691117d2b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.177696 Oct 02 00:57:49.704418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 193/388] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:49 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:50.263173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:50.263789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:50.270321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:50.270812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:50.271253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:50.271953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:50.272411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:50.272840 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:50.399974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:50.408656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-59fba12e-3597-4ebe-8295-ef4699915684 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.149353 Oct 02 00:57:50.409221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 196/389] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:50 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:50.728953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:50.729484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:50.736401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:50.736872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:50.737303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:50.737982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:50.738457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:50.738877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:50.866650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:50.875435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:50.876868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:50.878007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ceb7715e-16de-4e62-a58a-2edddca9c089 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.152978 Oct 02 00:57:50.878595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 194/390] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:50 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:51.432151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:51.432697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:51.435754 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:51.441477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:51.441958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:51.442423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:51.443119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:51.443571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:51.444068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:51.571197 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:51.580543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9feebd12-ddc3-472c-afef-a7320babded8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.152317 Oct 02 00:57:51.581167 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 197/391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:51 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:51.903815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:51.904417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:51.910792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:51.911269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:51.911698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:51.912388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:51.912838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:51.913258 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:52.109142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:52.118210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:52.119903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:52.121042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-636c379b-453a-4417-ae65-0e1529c3ed4a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.221146 Oct 02 00:57:52.122253 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 195/392] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:51 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:52.605641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:52.606294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:52.613085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:52.614400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:52.614869 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:52.616004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:52.616481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:52.616915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:52.756069 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:52.765019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-178ca807-abde-4fb3-aba1-d6e2cdf44db2 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.163737 Oct 02 00:57:52.765588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 198/393] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:52 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:53.152498 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:53.153104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:53.159433 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:53.159922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:53.160352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:53.161039 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:53.161486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:53.161906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:53.287567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:53.296914 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:53.298387 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:53.299555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f9bdfd1-d39c-4722-b31c-af2b55d0bb00 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.150880 Oct 02 00:57:53.300098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 196/394] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:53 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:53.787855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:53.788468 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:53.794913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:53.795390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:53.795822 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:53.796502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:53.796950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:53.797370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:53.925034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:53.928483 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:57:53.934021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ac1e97f1-bd5e-4d2c-a188-be24232a1b2e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.150028 Oct 02 00:57:53.934607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 199/395] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:53 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:54.324756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:54.325962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:54.332445 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:54.332942 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:54.333379 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:54.334091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:54.334560 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:54.334990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:54.460251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:54.468860 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:54.470336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:54.471482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-894d950f-83af-4709-b656-bf16da42b3da tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.150673 Oct 02 00:57:54.472048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 197/396] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:54 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:54.957621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:54.958269 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:54.965363 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:54.965860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:54.966327 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:54.967030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:54.967490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:54.967920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:55.096538 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:55.104746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cf5cb8f6-7ac7-4c6a-81dc-b8cf008799b4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1722 microversion: 2.1 time: 0.151654 Oct 02 00:57:55.105307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 200/397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:54 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:55.497667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:55.498368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:55.504761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:55.505238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:55.505672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:55.506390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:55.506847 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:55.507265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:55.633465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:55.642617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:55.644062 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:55.645205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-803bc339-1ad6-4f80-8898-f0916408f1ff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.152269 Oct 02 00:57:55.645754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 198/398] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:55 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:56.129685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:56.130327 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:56.136927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:56.137411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:56.137846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:56.139435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:56.140255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:56.140694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:56.267844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:56.275998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ba95c795-f2ee-40c6-862b-80e774e7e397 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1699 microversion: 2.1 time: 0.151529 Oct 02 00:57:56.276567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 201/399] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:56 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:57:56.298954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30b58472-0ca4-4c6c-8ac1-d8da4356c261 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:57:56.305100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30b58472-0ca4-4c6c-8ac1-d8da4356c261 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:56.305586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30b58472-0ca4-4c6c-8ac1-d8da4356c261 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:56.306026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30b58472-0ca4-4c6c-8ac1-d8da4356c261 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:56.368547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30b58472-0ca4-4c6c-8ac1-d8da4356c261 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Going to try to start instance {{(pid=120425) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 00:57:56.408451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30b58472-0ca4-4c6c-8ac1-d8da4356c261 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/action" status: 202 len: 0 microversion: 2.1 time: 0.113338 Oct 02 00:57:56.409032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 199/400] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:57:56 2022] POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:57:56.418107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:56.419337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:56.425374 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:56.425863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:56.426425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:56.427151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:56.427696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:56.428192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:56.564662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:56.573799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5b9e05c4-d100-4ddb-be50-1f4d8472fe6e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1708 microversion: 2.1 time: 0.160535 Oct 02 00:57:56.574405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 202/401] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:56 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:56.671739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:56.672472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:56.678576 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:56.679055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:56.679503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:56.680169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:56.680622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:56.681048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:56.881483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:56.891265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:56.892720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:56.893869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-692c6b56-9065-4cac-a392-338307eaf7fe tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.227484 Oct 02 00:57:56.894464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 200/402] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:56 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:57.597331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:57.597944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:57.604366 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:57.604847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:57.605278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:57.606535 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:57.606992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:57.607410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:57.808377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:57.817146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bccb47e0-88f8-4890-9ba0-e31effe17781 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1708 microversion: 2.1 time: 0.223698 Oct 02 00:57:57.817917 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 203/403] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:57 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1708 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:57.919943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:57.920553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:57.927056 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:57.927541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:57.927977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:57.928703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:57.929153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:57.929582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:58.083749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:58.092897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:58.094397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:58.095549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1af0b4b-b906-4339-af5d-573aed890377 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.180025 Oct 02 00:57:58.096111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 201/404] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:57 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:57:58.840189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:58.840799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:58.846741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:58.847232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:58.847666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:58.848355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:58.848809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:58.849230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:58.976721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:58.985757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-02810ba6-85bc-4387-8d06-0120a3d0ee96 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1708 microversion: 2.1 time: 0.149580 Oct 02 00:57:58.986363 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 204/405] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:57:58 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:57:59.120517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:57:59.121124 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:57:59.128259 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:59.128739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:59.129169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:59.129853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:57:59.130337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:57:59.130762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:57:59.254575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:59.263138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:59.264585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:57:59.265748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4bb9168b-b88e-47d9-881c-81a6e80beff5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.149418 Oct 02 00:57:59.266321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 202/406] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:57:59 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:00.009485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:00.010202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:00.016566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:00.017044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:00.017476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:00.018195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:00.018651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:00.019074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:00.145984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:00.154752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fabf8f46-7349-483f-b256-ad1711531213 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1712 microversion: 2.1 time: 0.149141 Oct 02 00:58:00.155313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 205/407] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:00 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1712 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:00.291181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:00.291777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:00.298841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:00.299316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:00.299739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:00.300427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:00.300901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:00.301316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:00.429312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:00.437862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:00.439321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:00.440833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a5ae1f32-915e-4656-92b5-535501b88010 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.153318 Oct 02 00:58:00.441412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 203/408] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:00 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:01.466458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:01.466997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:01.473387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:01.473867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:01.474339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:01.475028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:01.475486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:01.475913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:01.603339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:01.611808 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:01.613234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:01.614400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f3f88f50-9b8f-4280-b98f-fc40bda0057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.151918 Oct 02 00:58:01.614953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 206/409] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:01 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:02.311985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-63ef6daf-d738-47d4-86a1-3d19efc78074 req-ef0ee35c-4a17-4c66-920c-74f2a0febed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4241ee-1589-42f2-986e-abe5f0a2c369", "name": "network-vif-plugged", "status": "completed", "tag": "bb0e6fe9-481b-4e10-995c-f5411611262d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:02.322213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-63ef6daf-d738-47d4-86a1-3d19efc78074 req-ef0ee35c-4a17-4c66-920c-74f2a0febed9 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:02.322914 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-63ef6daf-d738-47d4-86a1-3d19efc78074 req-ef0ee35c-4a17-4c66-920c-74f2a0febed9 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:02.323467 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-63ef6daf-d738-47d4-86a1-3d19efc78074 req-ef0ee35c-4a17-4c66-920c-74f2a0febed9 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:02.336607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-63ef6daf-d738-47d4-86a1-3d19efc78074 req-ef0ee35c-4a17-4c66-920c-74f2a0febed9 service nova] Creating event network-vif-plugged:bb0e6fe9-481b-4e10-995c-f5411611262d for instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 on hv-cinder-maste Oct 02 00:58:02.342865 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-63ef6daf-d738-47d4-86a1-3d19efc78074 req-ef0ee35c-4a17-4c66-920c-74f2a0febed9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034542 Oct 02 00:58:02.343649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 204/410] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:02.641229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:02.641842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:02.648840 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:02.649327 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:02.649766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:02.650492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:02.651285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:02.651734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:02.794692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:02.803565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:02.805078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:02.806274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a5a3372b-b732-4763-85dd-7ad588bd38fa tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.169682 Oct 02 00:58:02.807020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 207/411] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:02 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:03.833118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:03.833806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:03.840974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:03.841432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:03.841856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:03.842565 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:03.843009 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:03.843439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:03.978549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:03.987093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:03.988512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:03.989643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ae4a947-cec0-42b6-b8a6-d16d75fb05c7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.160768 Oct 02 00:58:03.990228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 205/412] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:03 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:05.015502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:05.016262 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:05.022775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:05.023255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:05.023687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:05.024373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:05.024987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:05.025422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:05.074467 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4cf3559d-e08c-4aec-b203-0de55b86e40a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f07f5209-a0d8-41dd-809d-dec74e6b96e7"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:05.077345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4cf3559d-e08c-4aec-b203-0de55b86e40a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:05.084368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cf3559d-e08c-4aec-b203-0de55b86e40a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:05.085001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cf3559d-e08c-4aec-b203-0de55b86e40a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:05.085527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cf3559d-e08c-4aec-b203-0de55b86e40a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:05.086347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cf3559d-e08c-4aec-b203-0de55b86e40a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:05.087146 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cf3559d-e08c-4aec-b203-0de55b86e40a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:05.087783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cf3559d-e08c-4aec-b203-0de55b86e40a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:05.163196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:05.174546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:05.176042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:05.177269 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b1c6df4d-1acd-43b1-a684-0cb69e0a584c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1809 microversion: 2.20 time: 0.165598 Oct 02 00:58:05.177910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 208/413] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:05 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:05.365715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:05.376937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4cf3559d-e08c-4aec-b203-0de55b86e40a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306706 Oct 02 00:58:05.377545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 206/414] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 00:58:05 2022] POST /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:58:06.203351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:06.203967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:06.210351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:06.210836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:06.211272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:06.211967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:06.212421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:06.212847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:06.336893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:06.346221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:06.347662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:06.348805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0a4f386b-8008-40ba-b89b-5c9a65a6fda2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1796 microversion: 2.20 time: 0.149370 Oct 02 00:58:06.349360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 209/415] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:06 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1796 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:12.905457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:12.907802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:12.914423 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:12.914898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:12.915330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:12.916015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:12.916462 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:12.916882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:12.939363 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lazy-loading 'flavor' on Instance uuid 7da4fee8-13b9-487e-9186-c19e804d060f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:58:13.059754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6221dc0c-f00f-48f7-91b5-bc377bf832e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/action" status: 200 len: 32 microversion: 2.1 time: 0.159400 Oct 02 00:58:13.060390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 207/416] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:58:12 2022] POST /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:58:13.069712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:13.070355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:13.077642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:13.078153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:13.078590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:13.079288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:13.079742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:13.080166 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:13.528204 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:13.536563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-22f27bad-dc95-4f49-8ccc-b0e52372ffb2 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.470562 Oct 02 00:58:13.537134 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 210/417] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:13 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:14.561683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:14.562463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:14.568789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.569274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.569708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.570458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:14.570921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:14.571348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:14.697667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:14.706402 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-729b6685-b49a-4898-8c46-6d73d239faa7 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.149519 Oct 02 00:58:14.706973 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 208/418] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:14 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:15.729370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:15.730426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:15.737032 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:15.737517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:15.737958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:15.738680 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:15.739139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:15.739568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:15.870204 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:15.878343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1b0fb6d5-8c71-4152-802e-a15f445194ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.152900 Oct 02 00:58:15.878911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 211/419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:15 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:16.900740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:16.901347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:16.908020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:16.908502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:16.908938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:16.909641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:16.910095 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:16.910532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:17.039833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:17.048527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3fde3aba-efea-4ca0-a565-8b94aa7cca6d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.151659 Oct 02 00:58:17.049099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 209/420] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:16 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:18.072317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:18.072946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:18.079392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:18.079869 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:18.080298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.080981 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:18.081430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:18.081852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:18.216384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:18.224409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fbcb5d85-df8e-487e-b146-2b362c50b2cc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.155962 Oct 02 00:58:18.224969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 212/421] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:18 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:19.247877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:19.248485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:19.255731 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.256214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.256650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:19.257344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:19.257800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:19.258272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:19.385051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:19.393781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7a854ee-9c85-4b12-ae55-da92b8912f40 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.149796 Oct 02 00:58:19.394394 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 210/422] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:19 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:20.417625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:20.418168 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:20.424683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:20.425162 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:20.425596 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:20.426314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:20.426768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:20.427196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:20.553562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:20.562076 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f0be81a8-75ea-42f1-bfd7-a485d80b11e6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.148388 Oct 02 00:58:20.562640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 213/423] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:20 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:21.585487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:21.586119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:21.588496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=36 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:21.594357 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.594824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.595260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.595943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:21.596397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:21.596819 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:21.723507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:21.731562 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7739bce2-2936-48b7-a4b1-e96d0753e144 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.149941 Oct 02 00:58:21.732122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 211/424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:21 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:22.755095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:22.755706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:22.757949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=34 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:22.763804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:22.764283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:22.764719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:22.765398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:22.765852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:22.766306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:22.895166 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:22.903963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9340b8f1-487f-43f3-93de-efe9880aa70f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.152712 Oct 02 00:58:22.904522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 214/425] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:22 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:23.927074 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:23.927683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:23.934815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.935297 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.935735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:23.936424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:23.936876 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:23.937309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:24.066500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:24.074570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c8e527b-537f-4629-abca-82b169b4eac8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.151458 Oct 02 00:58:24.075127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 212/426] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:23 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:25.097911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:25.098591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:25.105562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:25.106041 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:25.106498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:25.107179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:25.107629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:25.108048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:25.111828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=91 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:25.231825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:25.240268 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d89ec195-7688-4884-8b8b-7636e3371f3d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.146202 Oct 02 00:58:25.240828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 215/427] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:25 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:26.263069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:26.263679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:26.270105 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.270589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.271026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:26.271714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:26.272170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:26.272592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:26.398924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:26.407017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da0684d9-7068-4307-8b53-ed3a129c7277 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1736 microversion: 2.1 time: 0.147880 Oct 02 00:58:26.407572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 213/428] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:26 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:27.430029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:27.430667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:27.437671 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.438196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.438638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.439333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.439786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.440209 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.565814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:27.574536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8510d68e-1dc4-4806-99f9-d1420ec3e914 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1716 microversion: 2.1 time: 0.148390 Oct 02 00:58:27.575095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 216/429] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:27 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:27.682464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:27.682956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:27.689435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.689912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.690374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.691057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.691533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.691954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.812506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] HTTP exception thrown: Cannot 'detach_volume' instance 7da4fee8-13b9-487e-9186-c19e804d060f while it is in vm_state rescued Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Request method failure captured: Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments/f07f5209-a0d8-41dd-809d-dec74e6b96e7 HTTP/1.1 Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFUgOoUORwJ-4C5H8x8ZefgUoj4fAo-4b23BL6QAt32ZVq1eedL7jjmzmZypIIqDsNbc0fqOIf2a45OsXp6o7sSnuTA6QBpSRBCFf7589pfDKBt35NHaCDH0aODsbLAt7rzkOX9wrlTWiwdiGrNamlUUvOi1ygyyHlw2deknU-cbG8 Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 00:58:27.814125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}] Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: afe98894d83f4678bb134782d90706e8 Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 00:58:27.815532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Cannot 'detach_volume' instance 7da4fee8-13b9-487e-9186-c19e804d060f while it is in vm_state rescued Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'server_id': '7da4fee8-13b9-487e-9186-c19e804d060f', 'id': 'f07f5209-a0d8-41dd-809d-dec74e6b96e7'} Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7da4fee8-13b9-487e-9186-c19e804d060f in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:58:27.816212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7da4fee8-13b9-487e-9186-c19e804d060f while it is in vm_state rescued Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7da4fee8-13b9-487e-9186-c19e804d060f while it is in vm_state rescued Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:27.817502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Returning 409 to user: Cannot 'detach_volume' instance 7da4fee8-13b9-487e-9186-c19e804d060f while it is in vm_state rescued {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:58:27.818577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-923b848f-b969-44ad-890c-b55acb99a5ce tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments/f07f5209-a0d8-41dd-809d-dec74e6b96e7" status: 409 len: 152 microversion: 2.1 time: 0.137044 Oct 02 00:58:27.818577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 214/430] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 00:58:27 2022] DELETE /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments/f07f5209-a0d8-41dd-809d-dec74e6b96e7 => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 02 00:58:27.824829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0352d9b9-e74e-4122-a188-e684d4b6c9ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:27.825387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0352d9b9-e74e-4122-a188-e684d4b6c9ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:27.831296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0352d9b9-e74e-4122-a188-e684d4b6c9ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.831776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0352d9b9-e74e-4122-a188-e684d4b6c9ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.832211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0352d9b9-e74e-4122-a188-e684d4b6c9ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.832897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0352d9b9-e74e-4122-a188-e684d4b6c9ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.833351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0352d9b9-e74e-4122-a188-e684d4b6c9ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.833780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0352d9b9-e74e-4122-a188-e684d4b6c9ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.898667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0352d9b9-e74e-4122-a188-e684d4b6c9ec tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "POST /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/action" status: 202 len: 0 microversion: 2.1 time: 0.077918 Oct 02 00:58:27.900899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 217/431] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:58:27 2022] POST /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:58:27.907468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:27.908201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:27.915144 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.915637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.916096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:27.916822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:27.917279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:27.917737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:28.131131 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:28.140027 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8bc9e868-da35-4b5b-ad6f-5a4f1e2a634a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1724 microversion: 2.1 time: 0.236449 Oct 02 00:58:28.140698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 215/432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:27 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:29.164338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:29.165043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:29.171652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.172135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.172574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.173267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:29.173726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:29.174187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:29.301913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:29.310658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-beddaf36-e156-49a7-973d-6c7a316a9e1d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1724 microversion: 2.1 time: 0.151274 Oct 02 00:58:29.311218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 218/433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:29 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:30.332804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:30.333331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:30.340261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.340741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.341202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.341884 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:30.342381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:30.342777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:30.470610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:30.478609 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-64920d86-642a-450a-a354-783503a7c359 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1724 microversion: 2.1 time: 0.149731 Oct 02 00:58:30.479682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 216/434] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:30 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:31.501701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:31.502350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:31.508712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:31.509186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:31.509614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:31.510325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:31.511284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:31.511703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:31.638351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:31.646404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-69576942-c2f3-4ec3-abf9-c9e482049e61 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1730 microversion: 2.1 time: 0.148531 Oct 02 00:58:31.646958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 219/435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:31 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:31.668396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1bbd0f0-ac37-4c9c-8770-bd0d357acd9e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:31.668889 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1bbd0f0-ac37-4c9c-8770-bd0d357acd9e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:31.675231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1bbd0f0-ac37-4c9c-8770-bd0d357acd9e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:31.675715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1bbd0f0-ac37-4c9c-8770-bd0d357acd9e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:31.676152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1bbd0f0-ac37-4c9c-8770-bd0d357acd9e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:31.676840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1bbd0f0-ac37-4c9c-8770-bd0d357acd9e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:31.677298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1bbd0f0-ac37-4c9c-8770-bd0d357acd9e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:31.677724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1bbd0f0-ac37-4c9c-8770-bd0d357acd9e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:31.754760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1bbd0f0-ac37-4c9c-8770-bd0d357acd9e tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089919 Oct 02 00:58:31.755358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 217/436] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Oct 2 00:58:31 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:32.680538 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-2129bc99-3cbd-484c-a591-9fe60c36e845 req-8cfcd35d-1639-47f7-b9c4-3b8160900961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da4fee8-13b9-487e-9186-c19e804d060f", "tag": "bf081b2d-5f2b-4115-9adf-ffd4e6381758"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:32.692479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2129bc99-3cbd-484c-a591-9fe60c36e845 req-8cfcd35d-1639-47f7-b9c4-3b8160900961 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:32.692853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2129bc99-3cbd-484c-a591-9fe60c36e845 req-8cfcd35d-1639-47f7-b9c4-3b8160900961 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:32.693283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2129bc99-3cbd-484c-a591-9fe60c36e845 req-8cfcd35d-1639-47f7-b9c4-3b8160900961 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:32.705734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-2129bc99-3cbd-484c-a591-9fe60c36e845 req-8cfcd35d-1639-47f7-b9c4-3b8160900961 service nova] Creating event network-changed:bf081b2d-5f2b-4115-9adf-ffd4e6381758 for instance 7da4fee8-13b9-487e-9186-c19e804d060f on hv-cinder-maste Oct 02 00:58:32.710887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-2129bc99-3cbd-484c-a591-9fe60c36e845 req-8cfcd35d-1639-47f7-b9c4-3b8160900961 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034864 Oct 02 00:58:32.711772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 220/437] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:58:34.725492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c788ca2a-2065-4a70-a6d2-0fc0a5ac379b req-d7932c69-9820-43d7-9715-991f2adbd634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da4fee8-13b9-487e-9186-c19e804d060f", "tag": "bf081b2d-5f2b-4115-9adf-ffd4e6381758"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:34.734858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c788ca2a-2065-4a70-a6d2-0fc0a5ac379b req-d7932c69-9820-43d7-9715-991f2adbd634 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:34.735323 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c788ca2a-2065-4a70-a6d2-0fc0a5ac379b req-d7932c69-9820-43d7-9715-991f2adbd634 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:34.735742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c788ca2a-2065-4a70-a6d2-0fc0a5ac379b req-d7932c69-9820-43d7-9715-991f2adbd634 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:34.747057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c788ca2a-2065-4a70-a6d2-0fc0a5ac379b req-d7932c69-9820-43d7-9715-991f2adbd634 service nova] Creating event network-changed:bf081b2d-5f2b-4115-9adf-ffd4e6381758 for instance 7da4fee8-13b9-487e-9186-c19e804d060f on hv-cinder-maste Oct 02 00:58:34.752747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c788ca2a-2065-4a70-a6d2-0fc0a5ac379b req-d7932c69-9820-43d7-9715-991f2adbd634 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031491 Oct 02 00:58:34.753415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 218/438] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:41.423721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:41.424334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:41.431227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:41.431706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:41.432737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:41.433436 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:41.433891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:41.434363 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:41.555933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lazy-loading 'services' on Instance uuid 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:58:41.667911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f31b99ea-2920-4fc4-b4d1-d92192ea83ed tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/os-volume_attachments/9b8cba92-1532-4ecd-b334-779c92f7624a" status: 202 len: 0 microversion: 2.1 time: 0.248318 Oct 02 00:58:41.668509 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 221/439] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 00:58:41 2022] DELETE /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/os-volume_attachments/9b8cba92-1532-4ecd-b334-779c92f7624a => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:58:42.793226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81508bd9-5a6b-46ec-bef2-ce8d7a7cef63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:42.800485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81508bd9-5a6b-46ec-bef2-ce8d7a7cef63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:42.801129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81508bd9-5a6b-46ec-bef2-ce8d7a7cef63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:42.801794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81508bd9-5a6b-46ec-bef2-ce8d7a7cef63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:42.825769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-81508bd9-5a6b-46ec-bef2-ce8d7a7cef63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Going to try to stop instance {{(pid=120425) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 02 00:58:42.868443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81508bd9-5a6b-46ec-bef2-ce8d7a7cef63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/action" status: 202 len: 0 microversion: 2.1 time: 0.080153 Oct 02 00:58:42.869053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 219/440] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:58:42 2022] POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:58:42.878453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:42.879158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:42.886116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:42.886577 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:42.887013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:42.887728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:42.888159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:42.888592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:43.026352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:43.037746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-63bd6133-c01a-40f0-86e8-382768f74553 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1676 microversion: 2.1 time: 0.162952 Oct 02 00:58:43.037920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 222/441] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:42 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:58:44.061427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:44.062191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:44.068307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.068792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.069226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.069924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.070410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.070839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.074080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=86,nova_cell1:UPDATE=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:44.512561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:44.520149 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77de26ea-0b50-4999-8d32-ef59beef1d06 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1676 microversion: 2.1 time: 0.463886 Oct 02 00:58:44.520754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 220/442] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:44 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1676 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:44.741314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b923b74a-f002-4303-8876-b1197865533c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:44.741846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b923b74a-f002-4303-8876-b1197865533c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:44.749259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b923b74a-f002-4303-8876-b1197865533c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.749919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b923b74a-f002-4303-8876-b1197865533c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.750307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b923b74a-f002-4303-8876-b1197865533c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.751106 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b923b74a-f002-4303-8876-b1197865533c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.751562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b923b74a-f002-4303-8876-b1197865533c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.751987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b923b74a-f002-4303-8876-b1197865533c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.781444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b923b74a-f002-4303-8876-b1197865533c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments/dd075850-e7df-4ab5-96d3-306918a5a503" status: 200 len: 194 microversion: 2.20 time: 0.044158 Oct 02 00:58:44.787954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 223/443] 10.222.0.25 () {60 vars in 1454 bytes} [Sun Oct 2 00:58:44 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments/dd075850-e7df-4ab5-96d3-306918a5a503 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:58:44.850208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:44.850842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:44.856988 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.857547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.858078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.858854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:44.859325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:44.859756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:44.940320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lazy-loading 'services' on Instance uuid 6c4241ee-1589-42f2-986e-abe5f0a2c369 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:58:45.055814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5542200f-bb7f-4601-9cb0-1edcc2ca3335 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments/dd075850-e7df-4ab5-96d3-306918a5a503" status: 202 len: 0 microversion: 2.20 time: 0.209401 Oct 02 00:58:45.056393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 221/444] 10.222.0.25 () {60 vars in 1457 bytes} [Sun Oct 2 00:58:44 2022] DELETE /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments/dd075850-e7df-4ab5-96d3-306918a5a503 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:58:45.066255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b9f5feb3-1e56-4d7d-9ae8-2571b8f0e7b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:45.068693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b9f5feb3-1e56-4d7d-9ae8-2571b8f0e7b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:45.075192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9f5feb3-1e56-4d7d-9ae8-2571b8f0e7b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.075765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9f5feb3-1e56-4d7d-9ae8-2571b8f0e7b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.076278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9f5feb3-1e56-4d7d-9ae8-2571b8f0e7b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.077162 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9f5feb3-1e56-4d7d-9ae8-2571b8f0e7b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.077693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9f5feb3-1e56-4d7d-9ae8-2571b8f0e7b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.078169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9f5feb3-1e56-4d7d-9ae8-2571b8f0e7b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.110524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b9f5feb3-1e56-4d7d-9ae8-2571b8f0e7b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048481 Oct 02 00:58:45.111087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 224/445] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Oct 2 00:58:45 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:58:45.544496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:45.545197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:45.551303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.551784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.552239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.552909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:45.553358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:45.553785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:45.684534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:45.692202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c39f4984-87da-484d-bfe1-89a581d07a38 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1676 microversion: 2.1 time: 0.153054 Oct 02 00:58:45.692765 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 222/446] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:45 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:46.124903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bcceeda7-f29d-4660-9730-f7a7496b16dc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:46.126983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bcceeda7-f29d-4660-9730-f7a7496b16dc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:46.133534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcceeda7-f29d-4660-9730-f7a7496b16dc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.134017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcceeda7-f29d-4660-9730-f7a7496b16dc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.134495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcceeda7-f29d-4660-9730-f7a7496b16dc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.135215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcceeda7-f29d-4660-9730-f7a7496b16dc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.135668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcceeda7-f29d-4660-9730-f7a7496b16dc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.136092 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcceeda7-f29d-4660-9730-f7a7496b16dc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.164092 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bcceeda7-f29d-4660-9730-f7a7496b16dc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043843 Oct 02 00:58:46.164635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 225/447] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Oct 2 00:58:46 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:46.226707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:46.227246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:46.233595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.234079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.234531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.235211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.235653 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.236066 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.263037 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:58:46.343538 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-daebb66c-4d46-43b4-9d64-c472ebd2f037 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 204 len: 0 microversion: 2.20 time: 0.120244 Oct 02 00:58:46.344178 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 223/448] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Oct 2 00:58:46 2022] DELETE /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 00:58:46.352972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:46.354237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:46.360112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.360593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.361026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.361712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.362198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.362620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.487895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:46.496116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:46.497547 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:46.498720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-677cf539-78b7-48a0-9411-3a73a009057f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.149704 Oct 02 00:58:46.499270 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 226/449] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:46 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:58:46.715347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:46.716045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:46.722645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.723119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.723550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.724239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:46.724689 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:46.725110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:46.855732 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:46.863358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db0300d2-20ce-4fd2-bcc9-2f6f331b1414 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1676 microversion: 2.1 time: 0.152182 Oct 02 00:58:46.863908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 224/450] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:46 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:47.524098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:47.524708 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:47.531118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.531600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.532040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:47.532751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.533191 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.533626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:47.659431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:47.668542 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:47.670000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:47.671185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9a02e201-b91c-4bb4-8fa5-0edb33594cce tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.151069 Oct 02 00:58:47.671746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 227/451] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:47 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:47.888051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:47.888608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:47.895050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.895537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.895974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:47.896673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:47.897128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:47.897558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.026350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:48.034449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aae047be-8c85-4abb-aaa2-15297c0dd951 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1676 microversion: 2.1 time: 0.150859 Oct 02 00:58:48.035237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 225/452] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:47 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:48.697252 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:48.697870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:48.704194 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.704675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.705091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.705810 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:48.707395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:48.707395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:48.967556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:48.978243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:48.980189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:48.981873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ba145901-08ed-41d3-9099-0448ece3796a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1724 microversion: 2.20 time: 0.289213 Oct 02 00:58:48.982417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 228/453] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:48 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:49.057416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:49.058022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:49.064436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:49.064916 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:49.065345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:49.066036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:49.066519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:49.066939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:49.286548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:49.295579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee3da804-10c8-44c0-94bd-0c93cb1a1d90 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1676 microversion: 2.1 time: 0.242607 Oct 02 00:58:49.296248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 226/454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:49 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:49.500886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-2e6b82c1-bb87-41fd-a965-2d54dde29c94 req-6fae5c43-5854-4647-a8b6-c33d7ac02f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4241ee-1589-42f2-986e-abe5f0a2c369", "name": "network-vif-deleted", "tag": "bb0e6fe9-481b-4e10-995c-f5411611262d"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:49.515583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2e6b82c1-bb87-41fd-a965-2d54dde29c94 req-6fae5c43-5854-4647-a8b6-c33d7ac02f71 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:49.515987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2e6b82c1-bb87-41fd-a965-2d54dde29c94 req-6fae5c43-5854-4647-a8b6-c33d7ac02f71 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:49.516413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2e6b82c1-bb87-41fd-a965-2d54dde29c94 req-6fae5c43-5854-4647-a8b6-c33d7ac02f71 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:49.528507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-2e6b82c1-bb87-41fd-a965-2d54dde29c94 req-6fae5c43-5854-4647-a8b6-c33d7ac02f71 service nova] Creating event network-vif-deleted:bb0e6fe9-481b-4e10-995c-f5411611262d for instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 on hv-cinder-maste Oct 02 00:58:49.533755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-2e6b82c1-bb87-41fd-a965-2d54dde29c94 req-6fae5c43-5854-4647-a8b6-c33d7ac02f71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036391 Oct 02 00:58:49.534382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 229/455] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:50.007325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:50.008167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:50.014682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.015376 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.015812 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.016513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.016967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.017393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.048709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.049193 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.049613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.050085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lazy-loading 'fault' on Instance uuid 6c4241ee-1589-42f2-986e-abe5f0a2c369 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:58:50.091736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:50.100308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:50.101748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:50.102961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2bff374-f69a-4881-915a-16e2284c78ea tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 200 len: 1371 microversion: 2.20 time: 0.099552 Oct 02 00:58:50.103588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 227/456] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:50 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:50.319019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:50.320362 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:50.328607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.329219 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.329691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.330497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:50.330964 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:50.331592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:50.478030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:50.488350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-daf33d6d-0b01-4c11-96f0-86ee27358c54 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1676 microversion: 2.1 time: 0.173396 Oct 02 00:58:50.489466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 230/457] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:50 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:51.129263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:51.129849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:51.136215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:51.136685 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:51.137111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:51.137790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:51.138270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:51.138984 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:51.153085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] HTTP exception thrown: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Request method failure captured: Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 HTTP/1.1 Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFWBQtVcLbllOpkW-5S-ru1Z7fiXDi2FLDYkQuVZQIpJgEOI5XkdasbxdTjURWOTMGUFwobqbPA6gBjFtlceFOn7ttIFNhgp67rXywsEbKp3GtzoDJ4GsyVTHo9wJm5vNPpJVgcmRoAnu-zlnpCxRcJCPG3feLubEm_i8dgNeEUrAg Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 00:58:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}] Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: a8894fd1044241ee8ba84927b6e8326a Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 00:58:51.156464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '6c4241ee-1589-42f2-986e-abe5f0a2c369'} Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:58:51.157348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 00:58:51.158607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 00:58:51.159694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Returning 404 to user: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:58:51.159694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac25e807-633f-435d-830a-23f2e0bb60a8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 404 len: 111 microversion: 2.20 time: 0.030816 Oct 02 00:58:51.159694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 228/458] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:51 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 00:58:51.164684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3dba9573-6a23-4251-9ad3-aa857537badf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '.version_select at 0x7f6e78f158b0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:51.184300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3dba9573-6a23-4251-9ad3-aa857537badf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-761101838" status: 204 len: 0 microversion: 2.20 time: 0.023285 Oct 02 00:58:51.184862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 231/459] 10.222.0.25 () {60 vars in 1259 bytes} [Sun Oct 2 00:58:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-761101838 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 02 00:58:51.512729 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:51.514168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:51.521859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:51.522650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:51.523230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:51.524300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:51.524894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:51.525908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:51.740552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:51.749021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e687ea44-9443-4a67-8ece-f3fce621f1b3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1676 microversion: 2.1 time: 0.240630 Oct 02 00:58:51.749830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 229/460] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:51 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:51.889788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4cfdb485-9539-4833-a173-2d01348cf56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'create', calling method: .version_select at 0x7f6e78f49dc0>, body: {"keypair": {"name": "tempest-keypair-552501722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr+W87QYRZwqyC2TDWUXQXQMN/czzbEaKMRqSyB0+7Vv313uwWHcXwJ65f1KgCC5Z56UoxY/BgW0AMpcdUd7FiqZB0IJW9Jd/nudfYNe+RRYCZpmGshWgRPwGWpLui/Cg=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:51.907802 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-4cfdb485-9539-4833-a173-2d01348cf56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Getting quotas for project ff4aef28dfc444ee914b56c64b2edb77. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:58:51.911554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-4cfdb485-9539-4833-a173-2d01348cf56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Getting quotas for user a8894fd1044241ee8ba84927b6e8326a and project ff4aef28dfc444ee914b56c64b2edb77. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:58:51.932688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4cfdb485-9539-4833-a173-2d01348cf56f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046712 Oct 02 00:58:51.933297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 232/461] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Oct 2 00:58:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 02 00:58:52.772881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:52.773430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:52.775825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:52.781191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:52.781813 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:52.782282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:52.783109 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:52.783530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:52.783960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:52.915476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:52.924096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ffd8e38e-52f7-4d68-a00c-c22d387da86a tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1676 microversion: 2.1 time: 0.155139 Oct 02 00:58:52.924655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 230/462] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:52 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:53.169535 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-14948912", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dfcbc66-8cd7-466b-a451-fff57570319b"}], "security_groups": [{"name": "tempest-securitygroup--1636936878"}], "key_name": "tempest-keypair-552501722", "user_data": "}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:53.177968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:53.271644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] validate_networks() for [('5dfcbc66-8cd7-466b-a451-fff57570319b', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:58:53.631992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:58:53.632421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:58:53.632905 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:58:53.633310 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:58:53.633713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:58:53.642836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:53.643316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:53.643742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:53.644455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:53.644900 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:53.645315 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:53.661586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Getting quotas for project ff4aef28dfc444ee914b56c64b2edb77. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:58:53.665666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Getting quotas for user a8894fd1044241ee8ba84927b6e8326a and project ff4aef28dfc444ee914b56c64b2edb77. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:58:53.676559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:58:53.678842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:58:53.725613 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cd4f5778-77a1-4dd5-9fda-941161a9f4d6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.561356 Oct 02 00:58:53.726284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 233/463] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Oct 2 00:58:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 02 00:58:53.737551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f07ed80c-f189-421b-80aa-70c888afe499 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:53.738285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f07ed80c-f189-421b-80aa-70c888afe499 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:53.792185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f07ed80c-f189-421b-80aa-70c888afe499 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:53.799506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f07ed80c-f189-421b-80aa-70c888afe499 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:53.800982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f07ed80c-f189-421b-80aa-70c888afe499 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:53.801972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f07ed80c-f189-421b-80aa-70c888afe499 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1279 microversion: 2.20 time: 0.068265 Oct 02 00:58:53.802605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 231/464] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:53 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1279 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:53.948188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:53.949117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:53.955483 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:53.955979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:53.956416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:53.957157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:53.957615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:53.958249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:53.962984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:54.100012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.109359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f6d13256-ddf4-410e-a0ec-b847ecd85f61 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1653 microversion: 2.1 time: 0.165930 Oct 02 00:58:54.122434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 234/465] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:53 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1653 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:54.133120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f46e178a-2837-4728-968f-dee08e2adc63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:54.139643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f46e178a-2837-4728-968f-dee08e2adc63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:54.140127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f46e178a-2837-4728-968f-dee08e2adc63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:54.140623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f46e178a-2837-4728-968f-dee08e2adc63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:54.162556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f46e178a-2837-4728-968f-dee08e2adc63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Going to try to start instance {{(pid=120425) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 02 00:58:54.205988 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f46e178a-2837-4728-968f-dee08e2adc63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/action" status: 202 len: 0 microversion: 2.1 time: 0.075847 Oct 02 00:58:54.207070 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 232/466] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:58:54 2022] POST /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 00:58:54.216257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:54.217030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:54.223775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:54.224488 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:54.224938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:54.225895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:54.226581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:54.227091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:54.359592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.367995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-847dc936-55c5-400a-8f8e-64ed538c3665 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1662 microversion: 2.1 time: 0.155940 Oct 02 00:58:54.368822 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 235/467] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:54 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:54.828466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:54.829156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:54.835676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:54.836147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:54.836575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:54.837255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:54.838319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:54.838738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:54.899869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.908425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.909848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:54.910953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-13c5f22b-98ca-43d4-ada7-151e78d6073a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1331 microversion: 2.20 time: 0.086762 Oct 02 00:58:54.911818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 233/468] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:54 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1331 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:55.392944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:55.393540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:55.400008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.400488 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.400921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:55.401604 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.402087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.402568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:55.803823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:55.812036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2d887715-ca28-4bf4-a3da-57c9b9f2fd6f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1662 microversion: 2.1 time: 0.422977 Oct 02 00:58:55.812608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 236/469] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:55 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1662 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:55.937023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:55.937645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:55.944472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.945046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.945673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:55.946472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:55.947016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:55.947469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:56.019380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:56.022141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:58:56.036687 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:56.037833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:56.038950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72b6ee61-2b28-498a-bc05-fafd5f97f368 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1337 microversion: 2.20 time: 0.106433 Oct 02 00:58:56.039497 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 234/470] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:55 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1337 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:56.835190 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:56.835828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:56.842256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:56.842809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:56.843313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:56.844070 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:56.844586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:56.845291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:57.047495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:57.055312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2bf6a895-b1c9-4ea6-8026-d2c5d3eacd07 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1666 microversion: 2.1 time: 0.224049 Oct 02 00:58:57.055878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 237/471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:58:56 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1666 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:58:57.064830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:57.065524 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:57.073060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:57.073550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:57.073984 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:57.074762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:57.075215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:57.075641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:57.219557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-7f2c6ce0-868e-438f-8f80-5a570ba19065 req-dd0c6396-940f-4e27-86f7-783189596b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807f29b0-19d4-4261-a69d-4c78413bc735", "tag": "5bb807a1-782e-4eeb-9592-d5bfdff8af48"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:58:57.230502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7f2c6ce0-868e-438f-8f80-5a570ba19065 req-dd0c6396-940f-4e27-86f7-783189596b07 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:57.230912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7f2c6ce0-868e-438f-8f80-5a570ba19065 req-dd0c6396-940f-4e27-86f7-783189596b07 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:57.231368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7f2c6ce0-868e-438f-8f80-5a570ba19065 req-dd0c6396-940f-4e27-86f7-783189596b07 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:57.241845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-7f2c6ce0-868e-438f-8f80-5a570ba19065 req-dd0c6396-940f-4e27-86f7-783189596b07 service nova] Creating event network-changed:5bb807a1-782e-4eeb-9592-d5bfdff8af48 for instance 807f29b0-19d4-4261-a69d-4c78413bc735 on hv-cinder-maste Oct 02 00:58:57.248926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-7f2c6ce0-868e-438f-8f80-5a570ba19065 req-dd0c6396-940f-4e27-86f7-783189596b07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033747 Oct 02 00:58:57.249682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 238/472] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:58:57.296737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:57.305174 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:57.306671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:57.307753 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a0ac546f-8876-4f58-b410-185c2a24900b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1405 microversion: 2.20 time: 0.247036 Oct 02 00:58:57.308309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 235/473] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:57 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:58.333303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:58.333910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:58.340571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:58.341046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:58.341480 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:58.342182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:58.342632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:58.343051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:58.471304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:58.479928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:58.481378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:58.482513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f56f66ae-7368-4f27-8d24-6eaa89aeb015 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1405 microversion: 2.20 time: 0.153490 Oct 02 00:58:58.483055 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 239/474] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:58 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:58:59.507797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:58:59.508405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:58:59.514816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:59.515320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:59.515753 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:59.516436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:58:59.516893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:58:59.517317 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:58:59.642802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:59.650879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:59.652324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:58:59.653409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8dfed3a4-777d-49eb-be52-85c5dc38eb07 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1405 microversion: 2.20 time: 0.149570 Oct 02 00:58:59.653955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 236/475] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:58:59 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:00.677996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:00.678591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:00.684985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.685461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.685922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.686637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:00.687091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:00.687513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:00.818611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:00.827139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:00.828577 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:00.829659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-42217e78-af07-4370-9096-130bee41908c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1405 microversion: 2.20 time: 0.155560 Oct 02 00:59:00.830238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 240/476] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:00 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:01.854355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:01.855001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:01.861342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:01.861816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:01.862284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:01.862968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:01.863440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:01.863856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:01.988060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:01.996792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:01.998243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:01.999352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c174695-1309-48ed-97df-4a683ab573fc tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1405 microversion: 2.20 time: 0.148905 Oct 02 00:59:01.999904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 237/477] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:01 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:02.573748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-53d9dce7-a7de-45cd-9b87-0cddc345a8af req-78d96cf9-50c7-46bd-83fd-377d228af85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807f29b0-19d4-4261-a69d-4c78413bc735", "name": "network-vif-plugged", "status": "completed", "tag": "5bb807a1-782e-4eeb-9592-d5bfdff8af48"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:02.584376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-53d9dce7-a7de-45cd-9b87-0cddc345a8af req-78d96cf9-50c7-46bd-83fd-377d228af85f service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:02.584870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-53d9dce7-a7de-45cd-9b87-0cddc345a8af req-78d96cf9-50c7-46bd-83fd-377d228af85f service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:02.585291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-53d9dce7-a7de-45cd-9b87-0cddc345a8af req-78d96cf9-50c7-46bd-83fd-377d228af85f service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:02.596595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-53d9dce7-a7de-45cd-9b87-0cddc345a8af req-78d96cf9-50c7-46bd-83fd-377d228af85f service nova] Creating event network-vif-plugged:5bb807a1-782e-4eeb-9592-d5bfdff8af48 for instance 807f29b0-19d4-4261-a69d-4c78413bc735 on hv-cinder-maste Oct 02 00:59:02.601371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-53d9dce7-a7de-45cd-9b87-0cddc345a8af req-78d96cf9-50c7-46bd-83fd-377d228af85f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 Oct 02 00:59:02.601965 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 241/478] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:03.023899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:03.024511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:03.032739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:03.033260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:03.033743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:03.034539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:03.035019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:03.035455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:03.168870 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:03.176366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:03.177806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:03.178925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-afb53f8a-bd22-4d63-81ab-43977fe478ad tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1405 microversion: 2.20 time: 0.158939 Oct 02 00:59:03.179630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 238/479] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:03 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:04.209085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:04.209921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=10 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:04.214094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:04.214780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:04.221603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:04.222090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:04.222521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:04.223198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:04.223645 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:04.224067 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:04.349400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:04.357959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:04.359420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:04.360531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-33864052-2e60-468b-bea4-ea90d825bc52 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1405 microversion: 2.20 time: 0.152810 Oct 02 00:59:04.361084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 242/480] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:04 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:05.019800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:05.020291 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:05.022145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:05.028650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.029142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.029582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.030319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.030780 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.031211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.110409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lazy-loading 'services' on Instance uuid 7da4fee8-13b9-487e-9186-c19e804d060f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:05.180168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8048924f-6989-43a7-a5dd-969e4bd05e02 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments/f07f5209-a0d8-41dd-809d-dec74e6b96e7" status: 202 len: 0 microversion: 2.1 time: 0.164099 Oct 02 00:59:05.181444 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 239/481] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 00:59:05 2022] DELETE /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments/f07f5209-a0d8-41dd-809d-dec74e6b96e7 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:59:05.189867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0ec001ca-7455-4ccb-94e8-dbace94c758d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:05.192114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0ec001ca-7455-4ccb-94e8-dbace94c758d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:05.198263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ec001ca-7455-4ccb-94e8-dbace94c758d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.198824 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ec001ca-7455-4ccb-94e8-dbace94c758d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.199330 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ec001ca-7455-4ccb-94e8-dbace94c758d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.200022 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ec001ca-7455-4ccb-94e8-dbace94c758d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.200474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ec001ca-7455-4ccb-94e8-dbace94c758d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.200890 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ec001ca-7455-4ccb-94e8-dbace94c758d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.230931 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0ec001ca-7455-4ccb-94e8-dbace94c758d tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Oct 02 00:59:05.231724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 243/482] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 00:59:05 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:05.386045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:05.386766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:05.392945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.393431 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.393867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.394626 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.395080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.395507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.524991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:05.533152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:05.534638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:05.535804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1259f8e3-886b-4d96-a76b-947d10b52ba9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1597 microversion: 2.20 time: 0.153944 Oct 02 00:59:05.536357 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 240/483] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:05 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:05.560313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b5a07218-8c4b-44ab-ae7e-17490778808b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:05.560800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b5a07218-8c4b-44ab-ae7e-17490778808b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:05.566643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5a07218-8c4b-44ab-ae7e-17490778808b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.567119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5a07218-8c4b-44ab-ae7e-17490778808b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.567545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5a07218-8c4b-44ab-ae7e-17490778808b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.568222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5a07218-8c4b-44ab-ae7e-17490778808b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:05.568665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5a07218-8c4b-44ab-ae7e-17490778808b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:05.569109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b5a07218-8c4b-44ab-ae7e-17490778808b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:05.643347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b5a07218-8c4b-44ab-ae7e-17490778808b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086826 Oct 02 00:59:05.643940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 244/484] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Oct 2 00:59:05 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:59:06.244214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-226c0734-c20e-453a-82d0-14fda0744e54 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:06.246473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-226c0734-c20e-453a-82d0-14fda0744e54 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:06.253275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226c0734-c20e-453a-82d0-14fda0744e54 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:06.253970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226c0734-c20e-453a-82d0-14fda0744e54 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:06.254625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226c0734-c20e-453a-82d0-14fda0744e54 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:06.255464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226c0734-c20e-453a-82d0-14fda0744e54 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:06.255897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226c0734-c20e-453a-82d0-14fda0744e54 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:06.256319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226c0734-c20e-453a-82d0-14fda0744e54 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:06.286120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-226c0734-c20e-453a-82d0-14fda0744e54 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046560 Oct 02 00:59:06.286733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 241/485] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 00:59:06 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:59:06.359693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:06.360787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:06.366778 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:06.367200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:06.368741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:06.369440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:06.369915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:06.370414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:06.396008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:59:06.472205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4f22bf34-f42e-4fd8-8bea-e92a5189d797 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 204 len: 0 microversion: 2.1 time: 0.117291 Oct 02 00:59:06.472975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 245/486] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 00:59:06 2022] DELETE /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:59:06.481609 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:06.482248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:06.488357 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:06.488874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:06.489308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:06.490019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:06.490511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:06.490935 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:06.602337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-4df6812b-84ff-47ac-96e8-7b1f14cd8a0a req-31668005-3c04-45dc-a63f-945271a8bc65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807f29b0-19d4-4261-a69d-4c78413bc735", "tag": "5bb807a1-782e-4eeb-9592-d5bfdff8af48"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:06.612283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-4df6812b-84ff-47ac-96e8-7b1f14cd8a0a req-31668005-3c04-45dc-a63f-945271a8bc65 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:06.613034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-4df6812b-84ff-47ac-96e8-7b1f14cd8a0a req-31668005-3c04-45dc-a63f-945271a8bc65 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:06.613458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-4df6812b-84ff-47ac-96e8-7b1f14cd8a0a req-31668005-3c04-45dc-a63f-945271a8bc65 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:06.625094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-4df6812b-84ff-47ac-96e8-7b1f14cd8a0a req-31668005-3c04-45dc-a63f-945271a8bc65 service nova] Creating event network-changed:5bb807a1-782e-4eeb-9592-d5bfdff8af48 for instance 807f29b0-19d4-4261-a69d-4c78413bc735 on hv-cinder-maste Oct 02 00:59:06.630257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-4df6812b-84ff-47ac-96e8-7b1f14cd8a0a req-31668005-3c04-45dc-a63f-945271a8bc65 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031813 Oct 02 00:59:06.631008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 246/487] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:59:06.652879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:06.660697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2aa42cc8-30ef-4524-9a6f-e3f21fd05023 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1690 microversion: 2.1 time: 0.183489 Oct 02 00:59:06.661353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 242/488] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:06 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:07.684767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:07.685453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:07.691774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:07.692289 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:07.692730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:07.693426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:07.693886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:07.694422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:07.827914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:07.835537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8532796e-dca7-46c3-9ee0-0ae97529dcef tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1690 microversion: 2.1 time: 0.155409 Oct 02 00:59:07.836105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 247/489] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:07 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:08.859047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:08.859648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:08.865959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:08.866465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:08.866895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:08.867839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:08.868896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:08.869316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:08.994012 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:09.001600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c348025d-971c-44f3-b39f-52401e2c09f9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1690 microversion: 2.1 time: 0.146354 Oct 02 00:59:09.002179 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 243/490] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:08 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:10.024370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:10.024978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:10.031500 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:10.031981 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:10.032415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:10.033097 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:10.033546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:10.033964 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:10.217724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:10.225541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-330ee302-731c-4eb3-a752-9850329108d6 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1690 microversion: 2.1 time: 0.205024 Oct 02 00:59:10.226123 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 248/491] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:10 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1690 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:11.249025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:11.249634 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:11.256086 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:11.256565 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:11.256991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:11.257676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:11.259123 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:11.259552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:11.356295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:11.365307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a7f0f8e-3b98-4c66-85ad-5d8534a51073 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1623 microversion: 2.1 time: 0.119932 Oct 02 00:59:11.366430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 244/492] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:11 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1623 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:11.620347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-b3c1945d-dd4a-4d22-b1d8-fe82f0b47492 req-750259c5-e1d0-49d5-a364-79dc5da3a0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da4fee8-13b9-487e-9186-c19e804d060f", "name": "network-vif-deleted", "tag": "bf081b2d-5f2b-4115-9adf-ffd4e6381758"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:11.629980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b3c1945d-dd4a-4d22-b1d8-fe82f0b47492 req-750259c5-e1d0-49d5-a364-79dc5da3a0d6 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:11.630496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b3c1945d-dd4a-4d22-b1d8-fe82f0b47492 req-750259c5-e1d0-49d5-a364-79dc5da3a0d6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:11.630911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b3c1945d-dd4a-4d22-b1d8-fe82f0b47492 req-750259c5-e1d0-49d5-a364-79dc5da3a0d6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:11.641745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-b3c1945d-dd4a-4d22-b1d8-fe82f0b47492 req-750259c5-e1d0-49d5-a364-79dc5da3a0d6 service nova] Creating event network-vif-deleted:bf081b2d-5f2b-4115-9adf-ffd4e6381758 for instance 7da4fee8-13b9-487e-9186-c19e804d060f on hv-cinder-maste Oct 02 00:59:11.646557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-b3c1945d-dd4a-4d22-b1d8-fe82f0b47492 req-750259c5-e1d0-49d5-a364-79dc5da3a0d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030712 Oct 02 00:59:11.647487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 249/493] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:12.391036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:12.391541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:12.398772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:12.399801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:12.400242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:12.401089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:12.401547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:12.402181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:12.435350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:12.435840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:12.436370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:12.436848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lazy-loading 'fault' on Instance uuid 7da4fee8-13b9-487e-9186-c19e804d060f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:12.481927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:12.495034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f644e274-ed05-4943-b60a-d02cda01ae96 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 200 len: 1336 microversion: 2.1 time: 0.108047 Oct 02 00:59:12.495638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 245/494] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:12 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:13.519624 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:13.520313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 7da4fee8-13b9-487e-9186-c19e804d060f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:13.527164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:13.527639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:13.528083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:13.528757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:13.529207 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:13.529626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:13.542642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] HTTP exception thrown: Instance 7da4fee8-13b9-487e-9186-c19e804d060f could not be found. Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Request method failure captured: Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f HTTP/1.1 Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFUgOoUORwJ-4C5H8x8ZefgUoj4fAo-4b23BL6QAt32ZVq1eedL7jjmzmZypIIqDsNbc0fqOIf2a45OsXp6o7sSnuTA6QBpSRBCFf7589pfDKBt35NHaCDH0aODsbLAt7rzkOX9wrlTWiwdiGrNamlUUvOi1ygyyHlw2deknU-cbG8 Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:59:13.544223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}] Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: afe98894d83f4678bb134782d90706e8 Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 7da4fee8-13b9-487e-9186-c19e804d060f could not be found. Oct 02 00:59:13.545683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '7da4fee8-13b9-487e-9186-c19e804d060f'} Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da4fee8-13b9-487e-9186-c19e804d060f could not be found. Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:59:13.546683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da4fee8-13b9-487e-9186-c19e804d060f could not be found. Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da4fee8-13b9-487e-9186-c19e804d060f could not be found. Oct 02 00:59:13.548383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:13.549857 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Returning 404 to user: Instance 7da4fee8-13b9-487e-9186-c19e804d060f could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:59:13.549857 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ad9a40ea-8213-43a8-bff5-898fe006e46a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f" status: 404 len: 111 microversion: 2.1 time: 0.030654 Oct 02 00:59:13.549857 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 250/495] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:13 2022] GET /compute/v2.1/servers/7da4fee8-13b9-487e-9186-c19e804d060f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:13.554136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f173bc33-2eb0-469e-bc3d-11d28464280a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '.version_select at 0x7f6e78e5be50>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:13.586619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f173bc33-2eb0-469e-bc3d-11d28464280a tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507105558" status: 202 len: 0 microversion: 2.1 time: 0.036164 Oct 02 00:59:13.587181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 246/496] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Oct 2 00:59:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507105558 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:59:16.618801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:16.619327 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:16.625832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:16.626349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:16.626783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:16.627472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:16.627924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:16.628348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:16.653756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:59:16.684371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:16.729023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6e91a212-4377-4b57-89c1-2013dcce5a0f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 204 len: 0 microversion: 2.1 time: 0.114762 Oct 02 00:59:16.729616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 251/497] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 00:59:16 2022] DELETE /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:59:16.737616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:16.738276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:16.745655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:16.746228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:16.746668 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:16.747359 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:16.747814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:16.748242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:16.879778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:16.888132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3e33fc75-be09-4f42-a8a8-c763ee1c62ba tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1508 microversion: 2.1 time: 0.154322 Oct 02 00:59:16.888693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 247/498] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:16 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:17.911979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:17.912584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:17.918953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:17.919428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:17.919861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:17.920543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:17.920992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:17.921412 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:18.050849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:18.058432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c1c32bb6-6f34-4ef6-b288-cc786b49a22f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1508 microversion: 2.1 time: 0.150754 Oct 02 00:59:18.058989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 252/499] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:17 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:19.080869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:19.081546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:19.088142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:19.088624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:19.089060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:19.089783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:19.090263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:19.090693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:19.214706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:19.222329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb263f5b-a067-47a7-9bb7-0cd018dd2f1f tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1508 microversion: 2.1 time: 0.145285 Oct 02 00:59:19.222904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 248/500] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:19 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:19.757127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-f0723a4a-007e-4ee1-9415-1902da5cdeaf req-c1997205-6ef9-45eb-a8a2-1d1f36fb4287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2912ff7b-f2a1-4be8-9c41-587be40143a4", "name": "network-vif-deleted", "tag": "afb680fd-62c7-44e9-af54-116ec99eda55"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:19.767976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f0723a4a-007e-4ee1-9415-1902da5cdeaf req-c1997205-6ef9-45eb-a8a2-1d1f36fb4287 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:19.768451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f0723a4a-007e-4ee1-9415-1902da5cdeaf req-c1997205-6ef9-45eb-a8a2-1d1f36fb4287 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:19.768877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f0723a4a-007e-4ee1-9415-1902da5cdeaf req-c1997205-6ef9-45eb-a8a2-1d1f36fb4287 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:19.781220 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-f0723a4a-007e-4ee1-9415-1902da5cdeaf req-c1997205-6ef9-45eb-a8a2-1d1f36fb4287 service nova] Creating event network-vif-deleted:afb680fd-62c7-44e9-af54-116ec99eda55 for instance 2912ff7b-f2a1-4be8-9c41-587be40143a4 on hv-cinder-maste Oct 02 00:59:19.786829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-f0723a4a-007e-4ee1-9415-1902da5cdeaf req-c1997205-6ef9-45eb-a8a2-1d1f36fb4287 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034096 Oct 02 00:59:19.787536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 253/501] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:20.246386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:20.247028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:20.253502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:20.253978 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:20.254434 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:20.255118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:20.255704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:20.256158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:20.286785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:20.287194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:20.287620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:20.288054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lazy-loading 'fault' on Instance uuid 2912ff7b-f2a1-4be8-9c41-587be40143a4 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:20.327778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:20.335250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5cf26ff6-6590-4a29-916f-f6e2890e56b3 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 200 len: 1311 microversion: 2.1 time: 0.093019 Oct 02 00:59:20.335814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 249/502] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:20 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:21.360252 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:21.360877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 2912ff7b-f2a1-4be8-9c41-587be40143a4] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:21.368435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.368913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.369344 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.370031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.370503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.370928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.384716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] HTTP exception thrown: Instance 2912ff7b-f2a1-4be8-9c41-587be40143a4 could not be found. Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Request method failure captured: Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 HTTP/1.1 Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFUgOoUORwJ-4C5H8x8ZefgUoj4fAo-4b23BL6QAt32ZVq1eedL7jjmzmZypIIqDsNbc0fqOIf2a45OsXp6o7sSnuTA6QBpSRBCFf7589pfDKBt35NHaCDH0aODsbLAt7rzkOX9wrlTWiwdiGrNamlUUvOi1ygyyHlw2deknU-cbG8 Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:59:21.386338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}] Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: afe98894d83f4678bb134782d90706e8 Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 2912ff7b-f2a1-4be8-9c41-587be40143a4 could not be found. Oct 02 00:59:21.387870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '2912ff7b-f2a1-4be8-9c41-587be40143a4'} Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2912ff7b-f2a1-4be8-9c41-587be40143a4 could not be found. Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:59:21.388790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2912ff7b-f2a1-4be8-9c41-587be40143a4 could not be found. Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2912ff7b-f2a1-4be8-9c41-587be40143a4 could not be found. Oct 02 00:59:21.390028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:21.391189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Returning 404 to user: Instance 2912ff7b-f2a1-4be8-9c41-587be40143a4 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:59:21.391189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-afee3f06-6228-4348-9d93-5330db549736 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4" status: 404 len: 111 microversion: 2.1 time: 0.031802 Oct 02 00:59:21.391189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 254/503] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:21 2022] GET /compute/v2.1/servers/2912ff7b-f2a1-4be8-9c41-587be40143a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:21.396255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:21.396747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:21.403075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.403575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.404006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.404712 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.405156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.405637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.432174 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:59:21.445625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:21.505546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2affb085-9ea2-4410-b317-b7a2749a42db tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 204 len: 0 microversion: 2.1 time: 0.112603 Oct 02 00:59:21.506250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 250/504] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 00:59:21 2022] DELETE /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:59:21.515307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:21.515919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:21.521806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.522328 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.522775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.523449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:21.523902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:21.524323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:21.654385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:21.661970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-10f6b862-f3d4-44cc-ab0a-2759068bc0dc tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.150672 Oct 02 00:59:21.662566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 255/505] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:21 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:22.685801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:22.686465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:22.692811 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:22.693296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:22.693735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:22.694460 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:22.694945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:22.695373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:22.823146 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:22.830871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-319a60aa-8f72-4948-8caf-312aee0fe504 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.149337 Oct 02 00:59:22.831450 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 251/506] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:22 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:23.853472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:23.854102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:23.856534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:23.861740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:23.862259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:23.862702 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:23.863400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:23.863854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:23.864279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:23.994002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:24.001605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9f083399-9222-462c-9b44-8f8cd3c425b8 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.152492 Oct 02 00:59:24.002195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 256/507] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:23 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:25.024310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:25.024928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:25.027436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:25.032858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.033414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.033848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.034586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.035047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.035477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.252673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:25.261106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24c3a929-d40f-443d-b46a-902574643001 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1521 microversion: 2.1 time: 0.240637 Oct 02 00:59:25.261681 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 252/508] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:25 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:25.573417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-e15649c8-8472-4f2c-833e-16ae1d42cea1 req-b9a1caf2-9031-4e4b-98c7-fad6c6dda64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6686edd9-ff59-4ebd-9253-f49114e9a954", "name": "network-vif-deleted", "tag": "41507aba-ced8-48a1-9f84-c484c0fd1778"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:25.583425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e15649c8-8472-4f2c-833e-16ae1d42cea1 req-b9a1caf2-9031-4e4b-98c7-fad6c6dda64e service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:25.583935 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e15649c8-8472-4f2c-833e-16ae1d42cea1 req-b9a1caf2-9031-4e4b-98c7-fad6c6dda64e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:25.584367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e15649c8-8472-4f2c-833e-16ae1d42cea1 req-b9a1caf2-9031-4e4b-98c7-fad6c6dda64e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:25.595541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-e15649c8-8472-4f2c-833e-16ae1d42cea1 req-b9a1caf2-9031-4e4b-98c7-fad6c6dda64e service nova] Creating event network-vif-deleted:41507aba-ced8-48a1-9f84-c484c0fd1778 for instance 6686edd9-ff59-4ebd-9253-f49114e9a954 on hv-cinder-maste Oct 02 00:59:25.601176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-e15649c8-8472-4f2c-833e-16ae1d42cea1 req-b9a1caf2-9031-4e4b-98c7-fad6c6dda64e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031055 Oct 02 00:59:25.602376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 257/509] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:26.283826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:26.284505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:26.291001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:26.291481 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:26.291987 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:26.292668 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:26.293053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:26.293477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:26.324763 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:26.325243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:26.325704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:26.326184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lazy-loading 'fault' on Instance uuid 6686edd9-ff59-4ebd-9253-f49114e9a954 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:26.368735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afe98894d83f4678bb134782d90706e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c22ffb83d7d41828375606fcc6da53f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:26.375990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83aa0f17-a358-42f6-8018-5b8d1ba189d9 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 200 len: 1311 microversion: 2.1 time: 0.096011 Oct 02 00:59:26.376562 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 253/510] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:26 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:27.399068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:27.399793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] [instance: 6686edd9-ff59-4ebd-9253-f49114e9a954] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:27.407879 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:27.408354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:27.408781 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:27.409792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:27.409899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:27.410360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:27.423239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] HTTP exception thrown: Instance 6686edd9-ff59-4ebd-9253-f49114e9a954 could not be found. Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Request method failure captured: Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 HTTP/1.1 Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFUgOoUORwJ-4C5H8x8ZefgUoj4fAo-4b23BL6QAt32ZVq1eedL7jjmzmZypIIqDsNbc0fqOIf2a45OsXp6o7sSnuTA6QBpSRBCFf7589pfDKBt35NHaCDH0aODsbLAt7rzkOX9wrlTWiwdiGrNamlUUvOi1ygyyHlw2deknU-cbG8 Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:59:27.424836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c22ffb83d7d41828375606fcc6da53f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c22ffb83d7d41828375606fcc6da53f"}]}] Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 4c22ffb83d7d41828375606fcc6da53f Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855820508 Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: afe98894d83f4678bb134782d90706e8 Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855820508-project Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 6686edd9-ff59-4ebd-9253-f49114e9a954 could not be found. Oct 02 00:59:27.426308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '6686edd9-ff59-4ebd-9253-f49114e9a954'} Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6686edd9-ff59-4ebd-9253-f49114e9a954 could not be found. Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:59:27.427258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6686edd9-ff59-4ebd-9253-f49114e9a954 could not be found. Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6686edd9-ff59-4ebd-9253-f49114e9a954 could not be found. Oct 02 00:59:27.428903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:27.430937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] Returning 404 to user: Instance 6686edd9-ff59-4ebd-9253-f49114e9a954 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:59:27.430937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2c18039b-76a5-4a37-8a40-61f1a10d8225 tempest-ServerRescueNegativeTestJSON-1855820508 tempest-ServerRescueNegativeTestJSON-1855820508-project] 10.222.0.25 "GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954" status: 404 len: 111 microversion: 2.1 time: 0.031338 Oct 02 00:59:27.430937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 258/511] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:27 2022] GET /compute/v2.1/servers/6686edd9-ff59-4ebd-9253-f49114e9a954 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:28.103067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:28.103721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:28.111652 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:28.112143 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:28.112570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:28.113439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:28.114108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:28.114715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:28.139518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lazy-loading 'flavor' on Instance uuid 6eb223bc-04ab-40a1-91da-3a3900ed7c11 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:28.210569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9f3b7bce-4e56-4f66-8b50-b6e915b58736 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "POST /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11/action" status: 202 len: 0 microversion: 2.1 time: 0.111287 Oct 02 00:59:28.211463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 254/512] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:59:28 2022] POST /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 00:59:28.220304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:28.221047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:28.228064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:28.229690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:28.230330 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:28.231229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:28.231686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:28.232107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:28.388157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:28.396224 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bf23dfde-dc68-4bd8-85fa-e49b4f3df782 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.180623 Oct 02 00:59:28.396810 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 259/513] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:28 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:29.420355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:29.421083 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:29.427241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:29.427722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:29.428264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:29.428963 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:29.429414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:29.429838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:29.658681 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:29.666409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-545d1de4-8c00-4ec7-b317-da73320dea92 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.250861 Oct 02 00:59:29.667057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 255/514] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:29 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:30.690623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:30.691423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:30.697959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:30.698638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:30.699251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:30.700110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:30.700559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:30.701151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:30.848359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:30.860944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6448f2fa-38f7-4066-b646-ad4439bd5f81 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.173718 Oct 02 00:59:30.874713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 260/515] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:30 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:31.885365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:31.885977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:31.892353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:31.892832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:31.893267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:31.893953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:31.894445 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:31.894871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.022625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:32.031404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20c0b571-d085-480e-b71f-f7d22ad4c201 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.150475 Oct 02 00:59:32.032199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 256/516] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:31 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:32.495966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2a41b243-ded0-4a48-92f7-90e05d9ae24f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:32.498237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2a41b243-ded0-4a48-92f7-90e05d9ae24f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:32.504705 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a41b243-ded0-4a48-92f7-90e05d9ae24f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.505186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a41b243-ded0-4a48-92f7-90e05d9ae24f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.505620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a41b243-ded0-4a48-92f7-90e05d9ae24f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.506346 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a41b243-ded0-4a48-92f7-90e05d9ae24f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.506800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a41b243-ded0-4a48-92f7-90e05d9ae24f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.507225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a41b243-ded0-4a48-92f7-90e05d9ae24f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.535893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2a41b243-ded0-4a48-92f7-90e05d9ae24f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044430 Oct 02 00:59:32.536432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 261/517] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 00:59:32 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 00:59:32.599006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:32.599495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:32.605535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.606006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.606463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.607140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.607585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.608003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.632330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 00:59:32.705501 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ec14d43-e3b6-4517-91b7-a41789240329 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 204 len: 0 microversion: 2.1 time: 0.109818 Oct 02 00:59:32.705989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 257/518] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 00:59:32 2022] DELETE /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:59:32.714378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:32.715013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:32.720849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.721322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.721747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.722453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:32.722907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:32.723327 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:32.831197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df3be5ec-58e8-4212-8e1c-c9e65ba6e035 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e78ea2940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:32.854775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:32.862445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ee615bfa-bb1a-4069-bd78-517bc8d6a957 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1672 microversion: 2.1 time: 0.152193 Oct 02 00:59:32.863008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 262/519] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:32 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:32.882124 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df3be5ec-58e8-4212-8e1c-c9e65ba6e035 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d3dbd61b-b1fe-45c6-ba39-a8978c123d83" status: 200 len: 351 microversion: 2.1 time: 0.055163 Oct 02 00:59:32.882745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 258/520] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:59:32 2022] GET /compute/v2.1/os-volumes/d3dbd61b-b1fe-45c6-ba39-a8978c123d83 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:59:33.055966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:33.056583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:33.063362 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:33.063896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:33.064409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:33.065624 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:33.065950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:33.066517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:33.201264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:33.209064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4a9094a8-7076-4a09-8dd7-e39cdb3a59ca tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.157384 Oct 02 00:59:33.209573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 263/521] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:33 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:33.886465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:33.887192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:33.893045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:33.893527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:33.893960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:33.894675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:33.895133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:33.895555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:34.019730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:34.027921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c6c2039-9ad1-494d-a748-1fb31aef69fa tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1672 microversion: 2.1 time: 0.145804 Oct 02 00:59:34.028480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 259/522] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:33 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:34.221180 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9a3cadf7-6d2f-4e28-bc31-3c694707adee tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e790c1310>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:34.233067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:34.233666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:34.239647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:34.240124 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:34.240549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:34.241266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:34.241763 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:34.242466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:34.374630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:34.383068 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80f91356-9f89-4581-9e14-d40013c0330a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.153165 Oct 02 00:59:34.383725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 260/523] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:34 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:34.388693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9a3cadf7-6d2f-4e28-bc31-3c694707adee tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/930c5935-7e9b-43ee-b7e8-49400d68fe24" status: 200 len: 350 microversion: 2.1 time: 0.171614 Oct 02 00:59:34.389393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 264/524] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:59:34 2022] GET /compute/v2.1/os-volumes/930c5935-7e9b-43ee-b7e8-49400d68fe24 => generated 350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:35.051400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:35.052003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:35.067343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:35.067839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:35.068672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:35.069580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:35.070901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:35.071430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:35.273984 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:35.282025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df522748-a10d-4bb0-a175-3951b393d13e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1672 microversion: 2.1 time: 0.234438 Oct 02 00:59:35.282632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 261/525] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:35 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1672 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:35.413025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:35.414329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:35.421232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:35.421798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:35.422269 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:35.422968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:35.423423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:35.423848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:35.659678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:35.668449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e7b68b46-22a1-4374-a24b-0619d339a784 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.259768 Oct 02 00:59:35.669166 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 265/526] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:35 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:35.722696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87e475b1-027d-4864-b75b-e2068d6ef780 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e78fd8430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:35.845025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87e475b1-027d-4864-b75b-e2068d6ef780 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff31b69-494d-4422-8cf5-e83fc170b670" status: 200 len: 351 microversion: 2.1 time: 0.126110 Oct 02 00:59:35.845848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 262/527] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Oct 2 00:59:35 2022] GET /compute/v2.1/os-volumes/3ff31b69-494d-4422-8cf5-e83fc170b670 => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:59:35.859961 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0778dab7-6566-488d-80ce-b28b0f46e301 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e78f49310>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:35.943582 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0778dab7-6566-488d-80ce-b28b0f46e301 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087527 Oct 02 00:59:35.944167 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 266/528] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Oct 2 00:59:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:35.958922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6eadcfa1-f779-4a9b-be94-ff7b96526ae5 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e7917e310>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.043184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6eadcfa1-f779-4a9b-be94-ff7b96526ae5 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087997 Oct 02 00:59:36.043756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 263/529] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Oct 2 00:59:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:36.057769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9cd5b95c-cf6f-4c3d-8b69-6c3169b207f3 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e78eb85e0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.142724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9cd5b95c-cf6f-4c3d-8b69-6c3169b207f3 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088810 Oct 02 00:59:36.143378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 267/530] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Oct 2 00:59:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:36.158235 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a00a990-7281-442c-899f-5769ce3b4a75 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e78f5b5e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.246515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a00a990-7281-442c-899f-5769ce3b4a75 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092792 Oct 02 00:59:36.247092 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 264/531] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Oct 2 00:59:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:36.261765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fd53365e-cd4d-41fa-83e2-ab3aad0837e2 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e78e88ca0>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.306348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.306967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:36.313198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:36.313682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:36.326280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:36.327041 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:36.327689 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:36.328123 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:36.385284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fd53365e-cd4d-41fa-83e2-ab3aad0837e2 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.127823 Oct 02 00:59:36.386406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 268/532] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Oct 2 00:59:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:36.391495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-cd722773-0912-4cb8-9f8b-6bbfab465d80 req-9f997a45-55f8-4dde-b1bf-42813d1ab988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f31c21f-46c0-4906-b0fd-ca8fb00439e8", "name": "network-vif-deleted", "tag": "429a9a97-9227-4530-a76b-a3eb80df7412"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:36.402526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-cd722773-0912-4cb8-9f8b-6bbfab465d80 req-9f997a45-55f8-4dde-b1bf-42813d1ab988 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:36.403243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-cd722773-0912-4cb8-9f8b-6bbfab465d80 req-9f997a45-55f8-4dde-b1bf-42813d1ab988 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:36.403829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-cd722773-0912-4cb8-9f8b-6bbfab465d80 req-9f997a45-55f8-4dde-b1bf-42813d1ab988 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:36.415603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-cd722773-0912-4cb8-9f8b-6bbfab465d80 req-9f997a45-55f8-4dde-b1bf-42813d1ab988 service nova] Creating event network-vif-deleted:429a9a97-9227-4530-a76b-a3eb80df7412 for instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 on hv-cinder-maste Oct 02 00:59:36.421640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-cd722773-0912-4cb8-9f8b-6bbfab465d80 req-9f997a45-55f8-4dde-b1bf-42813d1ab988 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033837 Oct 02 00:59:36.422814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 269/533] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:36.425970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:36.428122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-af650f18-a7c2-4dd4-94bc-0031acfdbd74 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e790c1c10>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.439438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-122ebfde-2d0b-420f-bce8-411fef011226 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 200 len: 1605 microversion: 2.1 time: 0.137365 Oct 02 00:59:36.441065 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 265/534] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:36 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 1605 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:36.524194 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-af650f18-a7c2-4dd4-94bc-0031acfdbd74 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100045 Oct 02 00:59:36.524757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 270/535] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Oct 2 00:59:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:36.538914 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-472ab8b2-0ce5-417c-b268-c02ecc0c5b71 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e78f5b4c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.626157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-472ab8b2-0ce5-417c-b268-c02ecc0c5b71 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091257 Oct 02 00:59:36.626730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 266/536] 10.222.0.25 () {58 vars in 1188 bytes} [Sun Oct 2 00:59:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:36.640204 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dcd41853-29a7-4f20-8aee-f01ae1500e72 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] Calling method '.version_select at 0x7f6e78e71670>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.695306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:36.695840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:36.702228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:36.702950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:36.703384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:36.704110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:36.704563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:36.704982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:36.710259 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:36.724678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dcd41853-29a7-4f20-8aee-f01ae1500e72 tempest-VolumesTestJSON-444778795 tempest-VolumesTestJSON-444778795-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088482 Oct 02 00:59:36.725819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 271/537] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Oct 2 00:59:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:36.865541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:36.865541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-812548c1-4c87-42b1-a26b-089b34a13e93 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.175345 Oct 02 00:59:36.865541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 267/538] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:36 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:37.464610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:37.465280 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:37.471485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:37.471973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:37.472408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:37.473095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:37.473569 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:37.473975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:37.487929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] HTTP exception thrown: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Request method failure captured: Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 HTTP/1.1 Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOGyLS7_TgH1f4o70XntOFVJsQTSBZjS0Vm2JCkci2Se2vm6p8s3Wa-JBzX8M2T4VUd2me-xnhUV0lcmzSItMAc7lZY0aEsMcdLtFJUVoN0lN36UnW4BFLrEejwpis10xDoKu-H-2AnVL9poBqvM2z5zUoxJhsRBhldIUiIKyDobHfs Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 00:59:37.489510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}] Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeTestJSON-2110823758 Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 6415bc1076204c78ad819ab2836a3652 Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 00:59:37.491038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '1f31c21f-46c0-4906-b0fd-ca8fb00439e8'} Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 00:59:37.492567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 00:59:37.494040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 00:59:37.495565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Returning 404 to user: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 00:59:37.495565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-09a8e356-48d6-4299-a713-38d6f28d18e4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 404 len: 111 microversion: 2.1 time: 0.030853 Oct 02 00:59:37.495565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 272/539] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:37 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 00:59:37.500278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fbc99fe7-0468-4313-b0f1-68dfff660c81 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '.version_select at 0x7f6e79200940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:37.518500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fbc99fe7-0468-4313-b0f1-68dfff660c81 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-991347848" status: 202 len: 0 microversion: 2.1 time: 0.021929 Oct 02 00:59:37.519065 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 268/540] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Oct 2 00:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-991347848 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:59:37.887940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:37.888559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:37.894748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:37.895230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:37.895657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:37.896555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:37.897166 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:37.897589 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:38.097497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:38.106176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1db7cb24-0dfc-4681-a899-4b97c7a7f41d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.222156 Oct 02 00:59:38.118273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 273/541] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:37 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:38.222036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5210f1b-c860-4101-9a75-daf3b174a6a0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'create', calling method: .version_select at 0x7f6e78e0c670>, body: {"keypair": {"name": "tempest-keypair-1360192824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrTgFQXeJtcb+SGW3Pe8MxNre3pirfw+S82LroI7Uy7cbrhj04mNSFGkzLWoIYX9lCMoESfDQW36OzszPMxDmTPcaHzF7tvfG/0JJWd2Q63hTQ1kiU/UBO6iSv/ZQzRXQ=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:38.244900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-e5210f1b-c860-4101-9a75-daf3b174a6a0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Getting quotas for project 6f2f218a688a41ab9e06269c4be3973d. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:59:38.248782 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-e5210f1b-c860-4101-9a75-daf3b174a6a0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Getting quotas for user 6415bc1076204c78ad819ab2836a3652 and project 6f2f218a688a41ab9e06269c4be3973d. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:59:38.274983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5210f1b-c860-4101-9a75-daf3b174a6a0 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057388 Oct 02 00:59:38.275504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 269/542] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 00:59:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:39.131318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:39.132849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:39.139866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.140536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.141256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.141929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:39.142565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:39.143160 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:39.297548 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:39.306584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f1c6c6c6-0066-4147-b288-39d168855ae7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.179680 Oct 02 00:59:39.307472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 274/543] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:39 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:39.810903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1090639601", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67365c61-9e99-4ca0-9e2a-e74a0e5c1767"}], "security_groups": [{"name": "tempest-securitygroup--1239934247"}], "key_name": "tempest-keypair-1360192824", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:39.909655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] validate_networks() for [('67365c61-9e99-4ca0-9e2a-e74a0e5c1767', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 00:59:40.268704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 00:59:40.269245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 00:59:40.270009 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 00:59:40.270461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 00:59:40.270875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 00:59:40.280822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:40.281307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:40.281745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:40.282510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:40.282967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:40.283394 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:40.300767 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Getting quotas for project 6f2f218a688a41ab9e06269c4be3973d. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 00:59:40.304719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Getting quotas for user 6415bc1076204c78ad819ab2836a3652 and project 6f2f218a688a41ab9e06269c4be3973d. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 00:59:40.315703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 00:59:40.318092 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 00:59:40.335034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:40.336301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:40.344946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:40.344946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:40.344946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:40.345296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:40.345815 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:40.346389 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:40.367088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b83c9683-a9b2-4598-b4d4-dff58729e897 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.560211 Oct 02 00:59:40.367736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 270/544] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 00:59:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 00:59:40.378518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-901ed427-e264-4b10-9b53-8977e36948e1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:40.379223 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-901ed427-e264-4b10-9b53-8977e36948e1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:40.456480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-901ed427-e264-4b10-9b53-8977e36948e1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:40.466744 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-901ed427-e264-4b10-9b53-8977e36948e1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1238 microversion: 2.1 time: 0.091703 Oct 02 00:59:40.479610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 271/545] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:40 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:40.542653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:40.550782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7d18d974-01c0-43a1-b20f-f85f3e4ac00c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.220684 Oct 02 00:59:40.561051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 275/546] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:40 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:41.488592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:41.489130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:41.496618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:41.497101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:41.497529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:41.498381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:41.498711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:41.499131 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:41.563169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:41.573153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8ba3a7b-401e-4a1f-89c4-197bea7f8506 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1290 microversion: 2.1 time: 0.088352 Oct 02 00:59:41.573721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 272/547] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:41 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:41.585694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:41.585694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:41.585694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:41.585694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:41.586631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:41.586631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:41.586631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:41.586631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:41.826900 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:41.835761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b8e93fd0-1954-4243-9fba-2575b18acc32 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.264171 Oct 02 00:59:41.836330 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 276/548] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:41 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:42.596391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:42.596976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:42.604466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:42.604948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:42.605380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:42.606100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:42.606559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:42.606984 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:42.704531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:42.712301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d937cc52-e27a-4a12-a4eb-d170d53fdc71 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1296 microversion: 2.1 time: 0.119872 Oct 02 00:59:42.712874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 273/549] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:42 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:42.861077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:42.861713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:42.869427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:42.870139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:42.870585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:42.871810 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:42.871810 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:42.872700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.080619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:43.082948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:43.090672 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1432f35d-1be2-44f8-8213-735b5ab871ef tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1508 microversion: 2.1 time: 0.233398 Oct 02 00:59:43.091281 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 277/550] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:42 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:43.113589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:43.114383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:43.120604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:43.121130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:43.121513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.122234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:43.122679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:43.123094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.155122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120425) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 00:59:43.236891 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48764295-01fb-41bb-8c65-c988a09e9bae tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "POST /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11/action" status: 202 len: 0 microversion: 2.1 time: 0.126722 Oct 02 00:59:43.241406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 274/551] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 00:59:43 2022] POST /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 00:59:43.253666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:43.254714 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:43.273784 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:43.274300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:43.274730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.275521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:43.276048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:43.276467 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.481192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:43.489051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8278fa9a-8ba5-4518-9ff6-9386a6c0c0c1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1516 microversion: 2.1 time: 0.240379 Oct 02 00:59:43.492173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 278/552] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:43 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1516 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:43.735993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:43.736913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:43.743397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:43.744133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:43.744568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.745640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:43.746492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:43.747749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.776221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-7a739458-b6f3-4228-a2ca-56d599081451 req-3f9ff719-7ca9-47c3-805d-0fbc99c7efa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609b6fb8-9eec-425d-b7f5-c31300a22be3", "tag": "9ff52132-5987-4860-b37d-9bb381e4ed44"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:43.794711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7a739458-b6f3-4228-a2ca-56d599081451 req-3f9ff719-7ca9-47c3-805d-0fbc99c7efa4 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:43.796755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7a739458-b6f3-4228-a2ca-56d599081451 req-3f9ff719-7ca9-47c3-805d-0fbc99c7efa4 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:43.797203 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7a739458-b6f3-4228-a2ca-56d599081451 req-3f9ff719-7ca9-47c3-805d-0fbc99c7efa4 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:43.821699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-7a739458-b6f3-4228-a2ca-56d599081451 req-3f9ff719-7ca9-47c3-805d-0fbc99c7efa4 service nova] Creating event network-changed:9ff52132-5987-4860-b37d-9bb381e4ed44 for instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 on hv-cinder-maste Oct 02 00:59:43.827263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-7a739458-b6f3-4228-a2ca-56d599081451 req-3f9ff719-7ca9-47c3-805d-0fbc99c7efa4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056271 Oct 02 00:59:43.828289 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 279/553] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:59:44.117293 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:44.132375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41e87586-1f8a-45de-ae04-656c221e7048 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1364 microversion: 2.1 time: 0.400176 Oct 02 00:59:44.138250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 275/554] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:43 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1364 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:44.514502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:44.515394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:44.521786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:44.522315 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:44.522801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:44.524190 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:44.524656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:44.525082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:44.782863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-65cac75d-e363-4186-bd4f-5aba667ea2ce req-bcf2227e-3e1c-4b11-b74e-1c3d96ab3501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb223bc-04ab-40a1-91da-3a3900ed7c11", "name": "network-vif-unplugged", "status": "completed", "tag": "35dfa250-2a82-4094-bfb8-cf1ecf3f6a10"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:44.793636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-65cac75d-e363-4186-bd4f-5aba667ea2ce req-bcf2227e-3e1c-4b11-b74e-1c3d96ab3501 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:44.794474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-65cac75d-e363-4186-bd4f-5aba667ea2ce req-bcf2227e-3e1c-4b11-b74e-1c3d96ab3501 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:44.794984 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-65cac75d-e363-4186-bd4f-5aba667ea2ce req-bcf2227e-3e1c-4b11-b74e-1c3d96ab3501 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:44.810043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.server_external_events [req-65cac75d-e363-4186-bd4f-5aba667ea2ce req-bcf2227e-3e1c-4b11-b74e-1c3d96ab3501 service nova] Unable to find a host for instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11. Dropping event network-vif-unplugged {{(pid=120425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 02 00:59:44.811267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-65cac75d-e363-4186-bd4f-5aba667ea2ce req-bcf2227e-3e1c-4b11-b74e-1c3d96ab3501 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032384 Oct 02 00:59:44.811855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 276/555] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 02 00:59:44.867722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:44.875697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e0ecab39-41c0-4aa8-8a27-dc0e63763499 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1518 microversion: 2.1 time: 0.365957 Oct 02 00:59:44.876354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 280/556] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:44 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1518 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:45.159237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:45.159846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:45.166157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:45.166715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:45.167149 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:45.167828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:45.168274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:45.168784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:45.306236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:45.313997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-664133af-53f5-4e98-9b61-2564b2807dcf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1364 microversion: 2.1 time: 0.158870 Oct 02 00:59:45.314696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 277/557] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:45 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:45.899499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:45.900104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:45.906534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:45.907013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:45.907444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:45.908126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:45.908573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:45.908985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:46.039594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:46.047336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3c055211-4100-4980-b1d1-402dc1e1655c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1518 microversion: 2.1 time: 0.152237 Oct 02 00:59:46.047897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 281/558] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:45 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:46.336475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:46.336974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:46.343327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:46.343778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:46.344200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:46.344877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:46.345321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:46.345734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:46.469976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:46.477946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9def428b-b45b-436d-a48d-3230df27977b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1364 microversion: 2.1 time: 0.145470 Oct 02 00:59:46.478527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 278/559] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:46 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:47.070474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:47.071082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:47.077679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:47.078188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:47.078624 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:47.079314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:47.079766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:47.080191 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:47.212562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:47.220446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-84c1f565-958b-4abf-af9c-40470ad3caa7 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1518 microversion: 2.1 time: 0.153791 Oct 02 00:59:47.221014 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 282/560] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:47 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:47.501361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:47.501972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:47.508978 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:47.509463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:47.509897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:47.510617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:47.511071 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:47.511492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:47.642377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:47.650182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b973f828-03db-40be-aeff-3c3dc629c299 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1364 microversion: 2.1 time: 0.152966 Oct 02 00:59:47.650749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 279/561] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:47 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:48.244339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:48.244949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:48.251403 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:48.251885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:48.252317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.253005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:48.253483 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:48.253934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.380271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:48.388537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-76bbc827-ef4d-4bc7-bc73-d33a02762e4c tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1518 microversion: 2.1 time: 0.148913 Oct 02 00:59:48.389098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 283/562] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:48 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:48.672462 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:48.673821 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:48.681387 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:48.682173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:48.682817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.683795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:48.684464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:48.685134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:48.913170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:48.922084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cd3c64d9-3589-4e28-9ccc-3cd242521c7b tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1364 microversion: 2.1 time: 0.253748 Oct 02 00:59:48.924659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 280/563] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:48 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:49.410336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:49.410940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:49.417185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:49.417658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:49.418103 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:49.418788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:49.419237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:49.419657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:49.743834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:49.751748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4e7bf686-32da-4ad9-bd23-16085a154fd6 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.345223 Oct 02 00:59:49.752526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 284/564] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:49 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:49.944814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:49.945578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:49.953520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:49.954003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:49.954465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:49.955165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:49.955613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:49.956040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:50.215692 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:50.234614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3814fa73-96c3-441f-ace7-638fe41254c8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1364 microversion: 2.1 time: 0.293585 Oct 02 00:59:50.237213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 281/565] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:49 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:50.472962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6e8f28ca-9567-4d72-9597-13459a76fd32 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:50.473453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6e8f28ca-9567-4d72-9597-13459a76fd32 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:50.480088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e8f28ca-9567-4d72-9597-13459a76fd32 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:50.480555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e8f28ca-9567-4d72-9597-13459a76fd32 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:50.480986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e8f28ca-9567-4d72-9597-13459a76fd32 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:50.481686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e8f28ca-9567-4d72-9597-13459a76fd32 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:50.482165 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e8f28ca-9567-4d72-9597-13459a76fd32 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:50.482592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e8f28ca-9567-4d72-9597-13459a76fd32 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:50.506032 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6e8f28ca-9567-4d72-9597-13459a76fd32 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/ips" status: 200 len: 151 microversion: 2.20 time: 0.156186 Oct 02 00:59:50.506609 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 285/566] 10.222.0.25 () {60 vars in 1289 bytes} [Sun Oct 2 00:59:50 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/ips => generated 151 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 00:59:50.776902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:50.777518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:50.779701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:50.780519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:50.790855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:50.791485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:50.792173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:50.792806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:50.793261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:50.793685 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:50.936784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:50.944914 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-812d29db-94f0-44a8-a463-dbfe6e2b6476 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.172317 Oct 02 00:59:50.945538 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 282/567] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:50 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:50.958910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-63b32f21-c1fc-40fa-b529-1dc8c3bcf632 req-38ac362f-ebac-4f06-96b0-0e9b98db0a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609b6fb8-9eec-425d-b7f5-c31300a22be3", "name": "network-vif-plugged", "status": "completed", "tag": "9ff52132-5987-4860-b37d-9bb381e4ed44"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:50.969743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-63b32f21-c1fc-40fa-b529-1dc8c3bcf632 req-38ac362f-ebac-4f06-96b0-0e9b98db0a4a service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:50.970395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-63b32f21-c1fc-40fa-b529-1dc8c3bcf632 req-38ac362f-ebac-4f06-96b0-0e9b98db0a4a service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:50.970895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-63b32f21-c1fc-40fa-b529-1dc8c3bcf632 req-38ac362f-ebac-4f06-96b0-0e9b98db0a4a service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:50.982877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-63b32f21-c1fc-40fa-b529-1dc8c3bcf632 req-38ac362f-ebac-4f06-96b0-0e9b98db0a4a service nova] Creating event network-vif-plugged:9ff52132-5987-4860-b37d-9bb381e4ed44 for instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 on hv-cinder-maste Oct 02 00:59:50.987748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-63b32f21-c1fc-40fa-b529-1dc8c3bcf632 req-38ac362f-ebac-4f06-96b0-0e9b98db0a4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032940 Oct 02 00:59:50.988336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 286/568] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:51.263656 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:51.264260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:51.270638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:51.271055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:51.271478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:51.272157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:51.272601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:51.273017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:51.400162 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:51.407638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eae95773-fd08-486c-9a44-53bc1e69f57e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1364 microversion: 2.1 time: 0.147845 Oct 02 00:59:51.408201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 283/569] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:51 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:51.969552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:51.970286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:51.976994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:51.977476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:51.977913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:51.978631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:51.979203 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:51.979703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.109696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:52.118244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-420082fc-9b93-4ce8-aec4-8b8d9bc3bff1 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.153371 Oct 02 00:59:52.118805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 287/570] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:51 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:52.342861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:52.343405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:52.349821 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.350328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.350761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.351441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.351888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.352305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.379758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lazy-loading 'flavor' on Instance uuid 807f29b0-19d4-4261-a69d-4c78413bc735 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 00:59:52.430715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:52.431325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:52.437529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.438021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.438505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.439215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.439681 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.440075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.572896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf25a8c7-6811-4a79-abf4-c5172dd2ebba tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/action" status: 202 len: 0 microversion: 2.20 time: 0.233999 Oct 02 00:59:52.573510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 284/571] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Oct 2 00:59:52 2022] POST /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 00:59:52.582389 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:52.583192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:52.586864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:52.590535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.591017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.591452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.592152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:52.592604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:52.593085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:52.598144 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:52.599733 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:52.606740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-002bbf55-c165-45b5-8883-d1b86a831508 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1364 microversion: 2.1 time: 0.179899 Oct 02 00:59:52.607536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 288/572] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:52 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 00:59:52.726491 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:52.735080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:52.736523 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:52.737677 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-45639dd2-e77a-47d9-8703-b98f5dacaeb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.159492 Oct 02 00:59:52.738255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 285/573] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:52 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 00:59:53.140519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:53.141131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:53.147972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:53.148448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:53.149408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:53.150114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:53.150560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:53.150978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:53.328331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:53.337320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b2eaab97-6206-4831-92a0-07386ee90d5e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.200568 Oct 02 00:59:53.337881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 289/574] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:53 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:53.629223 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:53.629836 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:53.637289 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:53.637777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:53.638351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:53.639051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:53.639539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:53.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:53.765600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:53.766655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:53.774150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:53.777181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:53.780680 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:53.781129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:53.782510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:53.783038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:53.783625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:53.785722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87227083-4c00-4be0-8efe-d1cbbb4e082e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1550 microversion: 2.1 time: 0.160201 Oct 02 00:59:53.786541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 286/575] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:53 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:53.809279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5369692d-249c-4d23-a149-247e02c7b08f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:53.810257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5369692d-249c-4d23-a149-247e02c7b08f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:53.816423 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5369692d-249c-4d23-a149-247e02c7b08f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:53.816910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5369692d-249c-4d23-a149-247e02c7b08f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:53.817343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5369692d-249c-4d23-a149-247e02c7b08f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:53.818049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5369692d-249c-4d23-a149-247e02c7b08f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:53.818605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5369692d-249c-4d23-a149-247e02c7b08f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:53.819033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5369692d-249c-4d23-a149-247e02c7b08f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:53.957072 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5369692d-249c-4d23-a149-247e02c7b08f tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152254 Oct 02 00:59:53.957674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 287/576] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Oct 2 00:59:53 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 00:59:54.004084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:54.012484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:54.014017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:54.015223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7b698e9e-16f8-4ac5-8fd2-5f7f7e9f50e8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.254159 Oct 02 00:59:54.015775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 290/577] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:53 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:54.360123 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:54.361018 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:54.370617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:54.371118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:54.371744 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:54.373525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:54.374203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:54.374629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:54.513098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:54.521094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-232dd3c5-bca7-4173-a18b-7aec8d01812a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.164769 Oct 02 00:59:54.522479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 288/578] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:54 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:54.923825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-f293f0ea-7262-4977-aab2-43901639deeb req-97846b48-a41e-46f3-8162-8c18d04f1bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609b6fb8-9eec-425d-b7f5-c31300a22be3", "tag": "9ff52132-5987-4860-b37d-9bb381e4ed44"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 00:59:54.929356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=58 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 00:59:54.936721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f293f0ea-7262-4977-aab2-43901639deeb req-97846b48-a41e-46f3-8162-8c18d04f1bc2 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:54.937554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f293f0ea-7262-4977-aab2-43901639deeb req-97846b48-a41e-46f3-8162-8c18d04f1bc2 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:54.938307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f293f0ea-7262-4977-aab2-43901639deeb req-97846b48-a41e-46f3-8162-8c18d04f1bc2 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:54.951943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-f293f0ea-7262-4977-aab2-43901639deeb req-97846b48-a41e-46f3-8162-8c18d04f1bc2 service nova] Creating event network-changed:9ff52132-5987-4860-b37d-9bb381e4ed44 for instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 on hv-cinder-maste Oct 02 00:59:54.956846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-f293f0ea-7262-4977-aab2-43901639deeb req-97846b48-a41e-46f3-8162-8c18d04f1bc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036870 Oct 02 00:59:54.957530 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 291/579] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 00:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 00:59:55.043994 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:55.045125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:55.054282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:55.055038 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:55.056287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:55.057290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:55.059233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:55.059861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:55.297610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:55.305826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:55.307584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:55.308986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9bcd0ff0-b4cc-41aa-94fe-791a8279867d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.271538 Oct 02 00:59:55.309777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 289/580] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:55 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:55.546970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:55.548824 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:55.559235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:55.560160 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:55.561600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:55.562608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:55.563384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:55.564241 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:55.747359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:55.759945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a5f583f2-27b3-41fa-a131-d39af107b6dd tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.217823 Oct 02 00:59:55.777004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 292/581] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:55 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:56.335640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:56.336777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:56.344269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:56.344747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:56.345174 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:56.345858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:56.346452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:56.347190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:56.477048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:56.485517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:56.486970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:56.488245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0fb934e8-25fb-4af7-aefb-d75ddbce1114 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.156389 Oct 02 00:59:56.488822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 290/582] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:56 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:56.783744 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:56.784503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:56.791452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:56.791930 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:56.792565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:56.793257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:56.793708 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:56.794152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:56.931059 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:56.938872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6df29acc-5655-435f-801c-f1c0e6d7a40d tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.158864 Oct 02 00:59:56.939437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 293/583] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:56 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:57.514386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:57.514927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:57.521526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:57.522000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:57.522462 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:57.523170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:57.524109 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:57.524530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:57.661134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:57.669224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:57.670706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:57.671854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc876fe0-2349-48e1-9ccd-65c42aac2727 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.161431 Oct 02 00:59:57.672407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 291/584] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:57 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:57.962054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:57.962742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:57.969295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:57.969779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:57.970253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:57.970954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:57.971422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:57.973318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:58.181875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:58.190288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d94c6234-6a38-4356-962f-f787a11c70d3 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.232193 Oct 02 00:59:58.190860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 294/585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:57 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:58.698293 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:58.699055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:58.705355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:58.705843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:58.706328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:58.707026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:58.707484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:58.708278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:58.845342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:58.854033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:58.855545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:58.856883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e8f754e-e092-456b-aba0-21a8b928c2ac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.163368 Oct 02 00:59:58.857610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 292/586] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:58 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 00:59:59.214440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:59.215057 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:59.221603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:59.222113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:59.222557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:59.223250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:59.223707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:59.224136 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:59.352983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 00:59:59.360625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d3da2691-3ceb-4b31-911c-0380e5ce70cb tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.150674 Oct 02 00:59:59.361181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 295/587] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 00:59:59 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 00:59:59.881845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 00:59:59.882537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 00:59:59.888898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:59.889370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:59.889797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 00:59:59.890527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 00:59:59.890977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 00:59:59.891395 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.019718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:00.028241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:00.029684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:00.030868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ff818eae-09f6-41db-b3cd-fe94257ace0c tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.152909 Oct 02 01:00:00.031426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 293/588] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 00:59:59 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:00.232126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-5141763", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "networks": [{"uuid": "6725837a-773e-4cd2-8a53-d386fca14560"}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:00.285192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] validate_networks() for [('6725837a-773e-4cd2-8a53-d386fca14560', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:00:00.384680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:00.385295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:00.391099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:00.391648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:00.392090 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.392782 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:00.393235 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:00.393656 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.837388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:00.845223 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-707cd08d-add0-412f-ac12-dcca2e0cfaa9 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.465011 Oct 02 01:00:00.845790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 294/589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:00 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:00.960010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:00:00.960643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:00:00.961117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:00:00.961523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:00:00.961933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:00:00.970727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:00.971202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:00.971627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.972343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:00.972789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:00.973206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:00.989493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Getting quotas for project 3b4519c281444cec82120fc744a4c5f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:00.996385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Getting quotas for user 0df9426abb5e495ea34429a5cccf9fe4 and project 3b4519c281444cec82120fc744a4c5f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:01.007303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:00:01.010238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:00:01.028149 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ba3ce0d9-5d2a-4644-840f-6a17597727bc req-0697a8fc-329a-4a97-8fef-48351f107861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb223bc-04ab-40a1-91da-3a3900ed7c11", "name": "network-vif-plugged", "status": "completed", "tag": "35dfa250-2a82-4094-bfb8-cf1ecf3f6a10"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:01.059044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ba3ce0d9-5d2a-4644-840f-6a17597727bc req-0697a8fc-329a-4a97-8fef-48351f107861 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:01.059532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ba3ce0d9-5d2a-4644-840f-6a17597727bc req-0697a8fc-329a-4a97-8fef-48351f107861 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:01.059964 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ba3ce0d9-5d2a-4644-840f-6a17597727bc req-0697a8fc-329a-4a97-8fef-48351f107861 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:01.068337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-be0d6140-34ea-4238-803e-7735af1f3b58 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839898 Oct 02 01:00:01.074959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ba3ce0d9-5d2a-4644-840f-6a17597727bc req-0697a8fc-329a-4a97-8fef-48351f107861 service nova] Creating event network-vif-plugged:35dfa250-2a82-4094-bfb8-cf1ecf3f6a10 for instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 on hv-cinder-maste Oct 02 01:00:01.075997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 296/590] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:00:01.081063 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:01.081438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ba3ce0d9-5d2a-4644-840f-6a17597727bc req-0697a8fc-329a-4a97-8fef-48351f107861 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058039 Oct 02 01:00:01.081686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:01.082472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 295/591] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:01.088410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27f4054a-87f3-451a-a29e-927ae9a1aeb9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:01.089372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27f4054a-87f3-451a-a29e-927ae9a1aeb9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:01.090972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:01.091466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:01.092089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:01.093003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:01.093615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:01.094242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:01.111816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:01.201015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-27f4054a-87f3-451a-a29e-927ae9a1aeb9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:01.209558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27f4054a-87f3-451a-a29e-927ae9a1aeb9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1211 microversion: 2.1 time: 0.125647 Oct 02 01:00:01.210377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 296/592] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:01 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:01.288667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:01.303350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:01.305530 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:01.306748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2ce2d3bf-2d27-4f4c-86b3-6be30a7810cf tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.229692 Oct 02 01:00:01.307354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 297/593] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:01 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:01.867422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:01.867947 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:01.874088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:01.874578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:01.875008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:01.875696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:01.876141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:01.876561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:02.001243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:02.009562 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af7f8f43-abf4-4876-9404-36e71c712d2b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1574 microversion: 2.1 time: 0.145842 Oct 02 01:00:02.010216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 297/594] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:01 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:02.232241 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:02.232853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:02.239035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:02.239546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:02.240052 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:02.241177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:02.241889 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:02.242345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:02.306407 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:02.314501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e5a9eea5-4e87-4e01-9fc2-73d1466599d8 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1263 microversion: 2.1 time: 0.086042 Oct 02 01:00:02.315075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 298/595] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:02 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:02.331866 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:02.332546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:02.340094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:02.340585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:02.341049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:02.341944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:02.342432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:02.342859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:02.471873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:02.481251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:02.482901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:02.484155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ece4968a-6ae5-474d-9d4a-11be3164b30b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.156421 Oct 02 01:00:02.484837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 298/596] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:02 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:03.032766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:03.033418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:03.039529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:03.040016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:03.040958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:03.041656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:03.042136 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:03.042565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:03.170251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:03.177943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6aa7ec21-6c59-417b-a4a1-12ea420e24f8 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1561 microversion: 2.1 time: 0.149048 Oct 02 01:00:03.178648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 299/597] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:03 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:03.339012 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:03.339626 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:03.345856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:03.346365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:03.346801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:03.347497 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:03.347957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:03.348377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:03.416520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:03.425678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad3c21cb-ad6e-438c-8a47-903f35517545 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1263 microversion: 2.1 time: 0.090912 Oct 02 01:00:03.427009 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 299/598] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:03 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1263 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:03.511095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:03.511710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:03.519776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:03.520345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:03.521018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:03.522468 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:03.523002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:03.523520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:03.726940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:03.735021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:03.736467 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:03.737617 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9361ae18-7323-4b36-8b74-1845e4887da5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.231103 Oct 02 01:00:03.738214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 300/599] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:03 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:04.448890 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:04.449447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:04.456076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:04.456563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:04.457001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:04.457701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:04.458180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:04.458617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:04.657267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:04.665003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ace8f220-58ae-4695-9be3-96065d458279 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1311 microversion: 2.1 time: 0.220031 Oct 02 01:00:04.666287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 300/600] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:04 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1311 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:04.764801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:04.765555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:04.772042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:04.772530 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:04.772968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:04.773669 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:04.774146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:04.775080 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:04.981256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:04.989469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:04.990965 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:04.992433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8b28d70c-20a6-4be2-a4d3-4e416336e2ee tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.231554 Oct 02 01:00:04.993035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 301/601] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:04 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:05.034297 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7b769148-ff89-49a9-b971-4c3824e5afe9 req-6a45d0c7-5fc4-4e8e-b267-3926cf297a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf2aa3eb-21bc-47f9-bce1-fccfdd111622", "tag": "6b60e9d5-e2ce-4fc7-81df-977b82f49ac6"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:05.048773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7b769148-ff89-49a9-b971-4c3824e5afe9 req-6a45d0c7-5fc4-4e8e-b267-3926cf297a68 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:05.049245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7b769148-ff89-49a9-b971-4c3824e5afe9 req-6a45d0c7-5fc4-4e8e-b267-3926cf297a68 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:05.049675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7b769148-ff89-49a9-b971-4c3824e5afe9 req-6a45d0c7-5fc4-4e8e-b267-3926cf297a68 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:05.060461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7b769148-ff89-49a9-b971-4c3824e5afe9 req-6a45d0c7-5fc4-4e8e-b267-3926cf297a68 service nova] Creating event network-changed:6b60e9d5-e2ce-4fc7-81df-977b82f49ac6 for instance bf2aa3eb-21bc-47f9-bce1-fccfdd111622 on hv-cinder-maste Oct 02 01:00:05.065884 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7b769148-ff89-49a9-b971-4c3824e5afe9 req-6a45d0c7-5fc4-4e8e-b267-3926cf297a68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035871 Oct 02 01:00:05.066675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 301/602] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:05.688519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:05.689125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:05.695100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:05.695578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:05.696010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:05.696691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:05.697141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:05.697560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:05.828024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:05.835806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b72c6c12-e0c9-4287-afe4-4051c4ad4d50 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1311 microversion: 2.1 time: 0.151115 Oct 02 01:00:05.836373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 302/603] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:05 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1311 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:06.020329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:06.021041 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:06.028874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:06.029419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:06.030025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:06.030956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:06.031418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:06.031842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:06.159057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:06.167086 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:06.168537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:06.169684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7cc63e27-506a-4c35-a183-4b5fc5d5b660 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.153567 Oct 02 01:00:06.170270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 302/604] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:06 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:06.861678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:06.862323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:06.869623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:06.870135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:06.870602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:06.871300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:06.871758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:06.872187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:07.019556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:07.027692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3927a6a3-bc29-4283-b1e1-4ab91cacd460 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1311 microversion: 2.1 time: 0.169942 Oct 02 01:00:07.028261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 303/605] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:06 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:07.195254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:07.195866 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:07.202081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:07.202574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:07.203013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:07.203705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:07.204153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:07.204624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:07.328666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:07.336733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:07.338870 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:07.340026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce3c8d6a-0bd0-4d05-87c6-fd37f8822518 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.148680 Oct 02 01:00:07.340589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 303/606] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:07 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:08.050786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:08.051399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:08.057694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:08.058217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:08.058674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:08.059364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:08.059819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:08.060241 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:08.186413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:08.194969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cad1fed6-c316-410f-983e-96d577bef8cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1311 microversion: 2.1 time: 0.147988 Oct 02 01:00:08.195552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 304/607] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:08 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:08.364757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:08.365283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:08.372714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:08.373188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:08.373639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:08.374347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:08.374795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:08.375213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:08.390596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:08.502871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:08.511604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:08.513061 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:08.514252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9d61310-2b12-4941-b122-09e860715eff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.153429 Oct 02 01:00:08.514808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 304/608] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:08 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:09.218303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:09.218933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:09.225325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:09.225803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:09.226269 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:09.226955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:09.227402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:09.227823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:09.356087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:09.363679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-491c9641-a934-4cc7-a80f-d5ae275d3d70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1311 microversion: 2.1 time: 0.149788 Oct 02 01:00:09.364248 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 305/609] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:09 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:09.538909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:09.539509 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:09.545997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:09.546579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:09.547010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:09.547698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:09.548148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:09.548566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:09.677043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:09.684952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:09.686407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:09.687546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d92a4415-28a0-4f18-9d18-4d8a4262dd36 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1742 microversion: 2.20 time: 0.152613 Oct 02 01:00:09.688093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 305/610] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:09 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:10.387236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:10.387768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:10.394180 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:10.394669 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:10.395106 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:10.395800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:10.396251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:10.396672 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:10.521564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:10.529786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e7a35f44-1bc4-4d31-8092-7bfbf5025ccd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1311 microversion: 2.1 time: 0.147022 Oct 02 01:00:10.530390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 306/611] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:10 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1311 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:10.713040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:10.713701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:10.720186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:10.720660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:10.721089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:10.721769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:10.722245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:10.722664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:10.853375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:10.861624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:10.863080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:10.864228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-419febb8-e19d-42da-ae16-d8fc3ad4ac43 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1742 microversion: 2.20 time: 0.155130 Oct 02 01:00:10.864814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 306/612] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:10 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:11.234482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-79a3ddba-b3f9-464d-a52d-c9741f14a81c req-9c8d8a98-003c-49d8-90aa-0a0d42fe4e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2aa3eb-21bc-47f9-bce1-fccfdd111622", "name": "network-vif-plugged", "status": "completed", "tag": "6b60e9d5-e2ce-4fc7-81df-977b82f49ac6"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:11.249257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:11.250081 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:11.252728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-79a3ddba-b3f9-464d-a52d-c9741f14a81c req-9c8d8a98-003c-49d8-90aa-0a0d42fe4e39 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.253343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-79a3ddba-b3f9-464d-a52d-c9741f14a81c req-9c8d8a98-003c-49d8-90aa-0a0d42fe4e39 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.253783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-79a3ddba-b3f9-464d-a52d-c9741f14a81c req-9c8d8a98-003c-49d8-90aa-0a0d42fe4e39 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.267356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-79a3ddba-b3f9-464d-a52d-c9741f14a81c req-9c8d8a98-003c-49d8-90aa-0a0d42fe4e39 service nova] Creating event network-vif-plugged:6b60e9d5-e2ce-4fc7-81df-977b82f49ac6 for instance bf2aa3eb-21bc-47f9-bce1-fccfdd111622 on hv-cinder-maste Oct 02 01:00:11.273026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-79a3ddba-b3f9-464d-a52d-c9741f14a81c req-9c8d8a98-003c-49d8-90aa-0a0d42fe4e39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042284 Oct 02 01:00:11.274121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 307/613] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:11.553420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:11.554002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:11.560729 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:11.563160 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.564096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.564096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.564760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.565211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.565826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.703817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:11.711505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21f1bea1-7576-4286-a888-52b2a7369fa9 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1311 microversion: 2.1 time: 0.163146 Oct 02 01:00:11.712063 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 307/614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:11 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:11.893611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:11.894958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:11.902795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.903422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.903918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:11.904683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:11.905202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:11.908113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:12.046390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:12.054755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:12.056300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:12.057461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3bb2f777-9887-497c-bef3-397f5e945fff tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1737 microversion: 2.20 time: 0.168094 Oct 02 01:00:12.058139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 308/615] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:11 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:12.734895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:12.739783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:12.752134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:12.752837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:12.753533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:12.754380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:12.755355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:12.755783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:12.898362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:12.907605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9271a3d-534b-4e8d-b2c9-449cc47e5011 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1311 microversion: 2.1 time: 0.176588 Oct 02 01:00:12.923088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 308/616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:12 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:13.084565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:13.085967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:13.094318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.094995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.095924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.096785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.097423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.098382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.272099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:13.288881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:13.289661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-da1a781c-0da8-4825-9c73-f04197de3a3b req-2b7bb15c-14fc-4e3c-83a8-d6d4a06e3dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807f29b0-19d4-4261-a69d-4c78413bc735", "name": "network-vif-plugged", "status": "completed", "tag": "5bb807a1-782e-4eeb-9592-d5bfdff8af48"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:13.290378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:13.291821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b4e419bb-997a-44e9-9e71-34c90e86ca25 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1737 microversion: 2.20 time: 0.212288 Oct 02 01:00:13.304571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-da1a781c-0da8-4825-9c73-f04197de3a3b req-2b7bb15c-14fc-4e3c-83a8-d6d4a06e3dbb service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.306054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-da1a781c-0da8-4825-9c73-f04197de3a3b req-2b7bb15c-14fc-4e3c-83a8-d6d4a06e3dbb service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.309462 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-da1a781c-0da8-4825-9c73-f04197de3a3b req-2b7bb15c-14fc-4e3c-83a8-d6d4a06e3dbb service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.312235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 309/617] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:13 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:13.324288 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-da1a781c-0da8-4825-9c73-f04197de3a3b req-2b7bb15c-14fc-4e3c-83a8-d6d4a06e3dbb service nova] Creating event network-vif-plugged:5bb807a1-782e-4eeb-9592-d5bfdff8af48 for instance 807f29b0-19d4-4261-a69d-4c78413bc735 on hv-cinder-maste Oct 02 01:00:13.329142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-da1a781c-0da8-4825-9c73-f04197de3a3b req-2b7bb15c-14fc-4e3c-83a8-d6d4a06e3dbb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044206 Oct 02 01:00:13.329737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 309/618] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:13.931560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:13.932213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:13.939021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.939512 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.939957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:13.940667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:13.941163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:13.941599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:14.079765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:14.087925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-970ff2fa-f800-4a60-a5eb-2e2f86f4f274 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1494 microversion: 2.1 time: 0.160139 Oct 02 01:00:14.088920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 310/619] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:13 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1494 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:14.330516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:14.331714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:14.348916 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:14.350373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:14.351600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:14.352570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:14.353030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:14.353483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:14.516118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:14.525399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:14.527485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:14.528663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0693b64-2f03-4a92-b385-7bc90829406d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1737 microversion: 2.20 time: 0.202924 Oct 02 01:00:14.529228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 310/620] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:14 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:14.737803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:14.739548 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:14.748657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:14.749142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:14.749573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:14.750643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:14.751381 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:14.751963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:14.784460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:00:14.866445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8ac00f93-00f9-4b92-8934-e23cb43adf63 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 204 len: 0 microversion: 2.1 time: 0.132748 Oct 02 01:00:14.867431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 311/621] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:00:14 2022] DELETE /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:00:14.876128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:14.877050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:14.883378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:14.883964 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:14.884501 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:14.885495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:14.886579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:14.887236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:15.043588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:15.055697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1c8e6d9-077d-4183-b9b5-3a809ff5cc0d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1500 microversion: 2.1 time: 0.183301 Oct 02 01:00:15.056416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 311/622] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:14 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1500 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:15.555086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:15.555878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:15.562722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:15.563213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:15.563655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:15.564357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:15.564813 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:15.565239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:15.704708 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:15.713833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:15.715522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:15.716867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-673d70f6-dacb-45fd-bee4-1efd136d3db8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1737 microversion: 2.20 time: 0.165983 Oct 02 01:00:15.734566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 312/623] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:15 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:16.079012 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:16.079628 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:16.088637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.089124 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.089557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.090312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.090765 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.091188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.236358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:16.244445 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9fb3ab5e-a426-4c3f-8c4e-8bf5480a51cc tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1500 microversion: 2.1 time: 0.169246 Oct 02 01:00:16.245620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 312/624] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:16 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:16.746615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:16.747840 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:16.754503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.755726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.756786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.757905 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:16.758625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:16.759426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:16.789662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:17.002043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:17.011181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:17.013735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:17.015186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0d82c45a-3581-4ddc-a932-c72072459db6 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1737 microversion: 2.20 time: 0.275512 Oct 02 01:00:17.033536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 313/625] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:16 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:17.283798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:17.284759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:17.293679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:17.294336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:17.294901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:17.296284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:17.296865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:17.297655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:17.414787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:17.426650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8889c98e-6bc4-4542-9979-c749c628a196 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 200 len: 1296 microversion: 2.1 time: 0.150764 Oct 02 01:00:17.427729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 314/626] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:17 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:17.536197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0b914163-ed45-45fd-ab06-67f6e982d23b req-cbfc6939-61e4-4777-99b2-9e4652f4a192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf2aa3eb-21bc-47f9-bce1-fccfdd111622", "name": "network-vif-deleted", "tag": "6b60e9d5-e2ce-4fc7-81df-977b82f49ac6"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:17.546927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0b914163-ed45-45fd-ab06-67f6e982d23b req-cbfc6939-61e4-4777-99b2-9e4652f4a192 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:17.551503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0b914163-ed45-45fd-ab06-67f6e982d23b req-cbfc6939-61e4-4777-99b2-9e4652f4a192 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:17.552106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0b914163-ed45-45fd-ab06-67f6e982d23b req-cbfc6939-61e4-4777-99b2-9e4652f4a192 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:17.566176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0b914163-ed45-45fd-ab06-67f6e982d23b req-cbfc6939-61e4-4777-99b2-9e4652f4a192 service nova] Creating event network-vif-deleted:6b60e9d5-e2ce-4fc7-81df-977b82f49ac6 for instance bf2aa3eb-21bc-47f9-bce1-fccfdd111622 on hv-cinder-maste Oct 02 01:00:17.573886 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0b914163-ed45-45fd-ab06-67f6e982d23b req-cbfc6939-61e4-4777-99b2-9e4652f4a192 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.371514 Oct 02 01:00:17.574578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 313/627] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:18.046209 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:18.049336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:18.056892 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:18.057429 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:18.057953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:18.058891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:18.059722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:18.060312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:18.228764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:18.237689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:18.239180 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:18.240324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-112522a9-2441-437f-af8e-ce42d6ee2322 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1737 microversion: 2.20 time: 0.199048 Oct 02 01:00:18.240872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 315/628] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:18 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:18.456598 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:18.457544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: bf2aa3eb-21bc-47f9-bce1-fccfdd111622] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:18.465137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:18.465718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:18.466260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:18.467104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:18.467878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:18.468583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:18.487981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] HTTP exception thrown: Instance bf2aa3eb-21bc-47f9-bce1-fccfdd111622 could not be found. Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Request method failure captured: Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 HTTP/1.1 Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOKO69RgLvANnB03OA2yte3396VUrIcFafB7ncGolw77Sbr5MAHBaEqMUSM91oJkwKG4KXozBPcjTZrotPFum-AyO65OTRPw_2tEcwIGM3EqkTfHdx7_TZNGRqqhnVl6L1MX85c6kbp5TBMyLASYVF4J5xxf6kUk4ky2XgmAwI7xiyw Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 3b4519c281444cec82120fc744a4c5f0 Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesActionsTest-1723336818 Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:00:18.490999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b4519c281444cec82120fc744a4c5f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3b4519c281444cec82120fc744a4c5f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3b4519c281444cec82120fc744a4c5f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b4519c281444cec82120fc744a4c5f0"}]}] Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesActionsTest-1723336818 Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 3b4519c281444cec82120fc744a4c5f0 Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesActionsTest-1723336818 Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesActionsTest-1723336818-project Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 0df9426abb5e495ea34429a5cccf9fe4 Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesActionsTest-1723336818-project Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance bf2aa3eb-21bc-47f9-bce1-fccfdd111622 could not be found. Oct 02 01:00:18.493225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': 'bf2aa3eb-21bc-47f9-bce1-fccfdd111622'} Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2aa3eb-21bc-47f9-bce1-fccfdd111622 could not be found. Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:18.494240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2aa3eb-21bc-47f9-bce1-fccfdd111622 could not be found. Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2aa3eb-21bc-47f9-bce1-fccfdd111622 could not be found. Oct 02 01:00:18.496453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:18.498464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Returning 404 to user: Instance bf2aa3eb-21bc-47f9-bce1-fccfdd111622 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:18.499384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d6bb65a-25b9-466e-b69b-a8692420bfc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622" status: 404 len: 111 microversion: 2.1 time: 0.047956 Oct 02 01:00:18.500152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 314/629] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:18 2022] GET /compute/v2.1/servers/bf2aa3eb-21bc-47f9-bce1-fccfdd111622 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:18.556699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1503940464", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "networks": [{"uuid": "6725837a-773e-4cd2-8a53-d386fca14560"}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:18.615681 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] validate_networks() for [('6725837a-773e-4cd2-8a53-d386fca14560', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:00:18.999267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:00:19.001350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:00:19.001350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:00:19.001350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:00:19.001350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:00:19.010029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.011230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.011657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.012390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.012971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.013409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.033352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Getting quotas for project 3b4519c281444cec82120fc744a4c5f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:00:19.037524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Getting quotas for user 0df9426abb5e495ea34429a5cccf9fe4 and project 3b4519c281444cec82120fc744a4c5f0. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:00:19.051175 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:00:19.053487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:00:19.104520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9ec5946d-179f-4314-a6c9-78510408c950 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551542 Oct 02 01:00:19.105444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 316/630] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:00:19.116945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-141aaee3-335c-4c90-96af-83002b6badc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:19.118262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-141aaee3-335c-4c90-96af-83002b6badc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:19.194592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-141aaee3-335c-4c90-96af-83002b6badc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:19.204474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-141aaee3-335c-4c90-96af-83002b6badc0 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1214 microversion: 2.1 time: 0.092013 Oct 02 01:00:19.218671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 315/631] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:19 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:19.267817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:19.268598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:19.277172 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.277866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.278446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.279735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:19.280433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:19.280964 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:19.481775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:19.501233 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:19.503378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:19.505067 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e6c30fc1-7521-4c1c-9972-8f9ab42b0f67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1737 microversion: 2.20 time: 0.241709 Oct 02 01:00:19.506169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 317/632] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:19 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:20.229743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:20.230929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:20.238579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:20.239099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:20.239534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:20.240376 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:20.240826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:20.241670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:20.311250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:20.319214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aaeeddea-8fc8-49c0-a992-785c7e16ad2c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1266 microversion: 2.1 time: 0.094316 Oct 02 01:00:20.319974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 316/633] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:20 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:20.532239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:20.533061 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:20.545516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:20.546411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:20.546945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:20.547904 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:20.548634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:20.549260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:20.800228 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:20.811469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:20.812957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:20.814152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5e0345e4-36e2-44a5-a7fb-503daefcfc0f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1737 microversion: 2.20 time: 0.285823 Oct 02 01:00:20.814904 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 318/634] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:20 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1737 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:21.345471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:21.346186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:21.352863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:21.353419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:21.353923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:21.354710 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:21.355246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:21.355737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:21.537935 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:21.545632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c395de9-5266-408f-9c34-44e541f0471b tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.204168 Oct 02 01:00:21.546224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 317/635] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:21 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:21.840839 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:21.841508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:21.848271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:21.848761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:21.849222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:21.849929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:21.850413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:21.850835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.283287 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:22.291336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:22.293436 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:22.294615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bdfcb6d4-26f8-40c5-8371-b6cf5e178448 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1719 microversion: 2.20 time: 0.457853 Oct 02 01:00:22.295206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 319/636] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:21 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1719 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:22.569099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:22.569706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:22.576176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.576655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.577089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.577788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.578274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.578707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.874265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:22.882096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df1bffa5-5ee2-4c42-8be7-8c13fb1f7da3 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.316769 Oct 02 01:00:22.894702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 318/637] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:22 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:22.921058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-3dcd15d7-9959-40c4-b4e9-1c36fdb2d005 req-cd869d50-52e6-4ba4-823a-657c060f99a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea02907-af21-408e-b7cd-71affdf8ae02", "tag": "2900dc08-dc75-41a3-8205-a188e5ca497e"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:22.930882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-3dcd15d7-9959-40c4-b4e9-1c36fdb2d005 req-cd869d50-52e6-4ba4-823a-657c060f99a6 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:22.931392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-3dcd15d7-9959-40c4-b4e9-1c36fdb2d005 req-cd869d50-52e6-4ba4-823a-657c060f99a6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:22.931825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-3dcd15d7-9959-40c4-b4e9-1c36fdb2d005 req-cd869d50-52e6-4ba4-823a-657c060f99a6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:22.942454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-3dcd15d7-9959-40c4-b4e9-1c36fdb2d005 req-cd869d50-52e6-4ba4-823a-657c060f99a6 service nova] Creating event network-changed:2900dc08-dc75-41a3-8205-a188e5ca497e for instance 8ea02907-af21-408e-b7cd-71affdf8ae02 on hv-cinder-maste Oct 02 01:00:22.947127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-3dcd15d7-9959-40c4-b4e9-1c36fdb2d005 req-cd869d50-52e6-4ba4-823a-657c060f99a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029771 Oct 02 01:00:22.948473 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 320/638] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:23.320627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.321245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:23.323267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=71 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:23.328739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.329249 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.329680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.330400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.330849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.331271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.456269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:23.464805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:23.466264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:23.467400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80c763fd-b942-4d10-8a4c-89f8db8c5ee8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1719 microversion: 2.20 time: 0.150691 Oct 02 01:00:23.467953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 319/639] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:23 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:23.907613 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:23.908309 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:23.914424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.914902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.915337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:23.916019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:23.916516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:23.916934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.052649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:24.060763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a9974255-6551-406c-8e1a-c67829dccf21 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.157353 Oct 02 01:00:24.061325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 321/640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:23 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:24.492347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:24.492948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:24.499986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.500461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.500919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.501602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:24.502049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:24.502493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:24.639170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:24.647183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:24.648620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:24.649749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-53d86eb7-c208-4632-8d21-79b9b2a6127e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1719 microversion: 2.20 time: 0.161608 Oct 02 01:00:24.650343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 320/641] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:24 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:25.083574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.084186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:25.090017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.090539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.090975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.091677 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.092128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.092746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.115591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-b8a35cca-5242-40b6-812f-5d3d713f7889 req-6b0c3577-daf7-42b6-8e14-627cbc0fca5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807f29b0-19d4-4261-a69d-4c78413bc735", "name": "network-vif-unplugged", "status": "completed", "tag": "5bb807a1-782e-4eeb-9592-d5bfdff8af48"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:25.121460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:25.127882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b8a35cca-5242-40b6-812f-5d3d713f7889 req-6b0c3577-daf7-42b6-8e14-627cbc0fca5d service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.128362 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b8a35cca-5242-40b6-812f-5d3d713f7889 req-6b0c3577-daf7-42b6-8e14-627cbc0fca5d service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.128797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b8a35cca-5242-40b6-812f-5d3d713f7889 req-6b0c3577-daf7-42b6-8e14-627cbc0fca5d service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.142049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-b8a35cca-5242-40b6-812f-5d3d713f7889 req-6b0c3577-daf7-42b6-8e14-627cbc0fca5d service nova] Creating event network-vif-unplugged:5bb807a1-782e-4eeb-9592-d5bfdff8af48 for instance 807f29b0-19d4-4261-a69d-4c78413bc735 on hv-cinder-maste Oct 02 01:00:25.146901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-b8a35cca-5242-40b6-812f-5d3d713f7889 req-6b0c3577-daf7-42b6-8e14-627cbc0fca5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101146 Oct 02 01:00:25.147691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 322/642] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:25.220430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:25.228048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f738c084-9e3c-4c9c-89df-c4e05a65119a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.148225 Oct 02 01:00:25.228612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 321/643] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:25 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:25.676391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:25.677094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:25.683890 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.684378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.684916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.685663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.686126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.686556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.812415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:25.820441 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:25.821927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:25.823615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-baed9b19-8492-4fa8-899f-fa60e304c924 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1662 microversion: 2.20 time: 0.151480 Oct 02 01:00:25.824175 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 323/644] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:25 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:25.848861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-336c1c33-538e-4642-8520-29bc0d6d5272 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67067e3b-d6c3-4764-bbe0-21b6ea62e808"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:25.851292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-336c1c33-538e-4642-8520-29bc0d6d5272 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:25.857674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-336c1c33-538e-4642-8520-29bc0d6d5272 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.858190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-336c1c33-538e-4642-8520-29bc0d6d5272 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.858622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-336c1c33-538e-4642-8520-29bc0d6d5272 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:25.859297 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-336c1c33-538e-4642-8520-29bc0d6d5272 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:25.859743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-336c1c33-538e-4642-8520-29bc0d6d5272 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:25.860156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-336c1c33-538e-4642-8520-29bc0d6d5272 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.045289 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:26.144416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-336c1c33-538e-4642-8520-29bc0d6d5272 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299477 Oct 02 01:00:26.145042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 322/645] 10.222.0.25 () {62 vars in 1364 bytes} [Sun Oct 2 01:00:25 2022] POST /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 02 01:00:26.255477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.256114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:26.262667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.263156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.263594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.264286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.264776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.265199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.268326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d21c423-02bb-4e56-ae28-0e7dab897c3e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.268817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d21c423-02bb-4e56-ae28-0e7dab897c3e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:26.275507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d21c423-02bb-4e56-ae28-0e7dab897c3e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.276447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d21c423-02bb-4e56-ae28-0e7dab897c3e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.276870 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d21c423-02bb-4e56-ae28-0e7dab897c3e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.277570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d21c423-02bb-4e56-ae28-0e7dab897c3e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.278000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d21c423-02bb-4e56-ae28-0e7dab897c3e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.278451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d21c423-02bb-4e56-ae28-0e7dab897c3e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.401146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:26.408893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a4960529-91ca-42dd-9c41-70b1f9f2a93a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.161983 Oct 02 01:00:26.409458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 324/646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:26.520645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d21c423-02bb-4e56-ae28-0e7dab897c3e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/os-volume_attachments/67067e3b-d6c3-4764-bbe0-21b6ea62e808" status: 202 len: 0 microversion: 2.20 time: 0.256322 Oct 02 01:00:26.521230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 323/647] 10.222.0.25 () {60 vars in 1457 bytes} [Sun Oct 2 01:00:26 2022] DELETE /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/os-volume_attachments/67067e3b-d6c3-4764-bbe0-21b6ea62e808 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:00:26.581476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:26.582082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:26.587883 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.588394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.588832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.589518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.589969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.590427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.633899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120424) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 02 01:00:26.701786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4402b030-82c9-405c-9a16-8a2eea530e4f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "POST /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/action" status: 202 len: 0 microversion: 2.20 time: 0.124114 Oct 02 01:00:26.702425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 325/648] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Oct 2 01:00:26 2022] POST /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:00:26.710503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:26.711111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:26.717315 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.717806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.718276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.718970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:26.719424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:26.719880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:26.852729 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:26.862476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:26.863899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:26.865067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d29b78cf-1f66-446c-a732-daa93aab700f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1670 microversion: 2.20 time: 0.158460 Oct 02 01:00:26.865627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 324/649] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:26 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:27.432716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.433258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:27.439162 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.439687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.440122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:27.440824 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.441277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.441700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:27.574793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:27.582447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a5a3d2f7-f613-4f05-89b5-994925d94ffd tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.154266 Oct 02 01:00:27.583001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 326/650] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:27.890495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:27.891083 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:27.897435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.897918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.898386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:27.899071 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:27.899515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:27.899932 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:28.092192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:28.100224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:28.101805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:28.102986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bf12b2a-3feb-432a-836a-7ee59182f5af tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.216337 Oct 02 01:00:28.103547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 325/651] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:27 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:28.605079 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:28.605694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:28.611782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:28.612262 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:28.612695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:28.613427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:28.613898 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:28.614351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:28.745217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:28.753338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a886f12b-82c9-4cfe-b319-d8887355b3c4 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.152617 Oct 02 01:00:28.754045 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 327/652] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:28 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:29.132555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:29.133271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:29.144388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:29.145034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:29.145809 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:29.146965 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:29.147568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:29.148262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:29.219458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:29.347343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:29.356510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:29.357995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:29.359209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b2bdf5a-c873-42b6-b330-115e625f5f84 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.232849 Oct 02 01:00:29.377879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 326/653] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:29 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:29.778351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:29.778975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:29.781909 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:29.782696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:29.787556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:29.788174 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:29.788631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:29.789319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:29.789772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:29.790231 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:29.945356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:29.953878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bb4092bb-8fca-4e4a-ae7e-f8dd646edde5 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.180084 Oct 02 01:00:29.954491 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 328/654] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:29 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:30.386098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:30.387192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:30.393686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:30.394208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:30.394639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:30.395323 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:30.395773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:30.396199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:30.533846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:30.542672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:30.544129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:30.545280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-12d5d07d-6dec-4c34-b4a6-d8ae41a91b6a tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.163642 Oct 02 01:00:30.545838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 327/655] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:30 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:30.987060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:30.988444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:30.998572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04041393-2a92-4416-8538-a888e0020b7e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:30.999717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-04041393-2a92-4416-8538-a888e0020b7e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:31.003990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.004769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.005398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.006237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.006835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.007406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.007617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04041393-2a92-4416-8538-a888e0020b7e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.008307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04041393-2a92-4416-8538-a888e0020b7e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.008926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04041393-2a92-4416-8538-a888e0020b7e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.010786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04041393-2a92-4416-8538-a888e0020b7e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.011434 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04041393-2a92-4416-8538-a888e0020b7e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.012269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04041393-2a92-4416-8538-a888e0020b7e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.065270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04041393-2a92-4416-8538-a888e0020b7e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/ips" status: 200 len: 145 microversion: 2.1 time: 0.070427 Oct 02 01:00:31.084107 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 328/656] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 01:00:30 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/ips => generated 145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:31.235683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:31.246283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bbb67187-c064-4739-9ef3-9af62337af70 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.272595 Oct 02 01:00:31.264934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 329/657] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:30 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:31.307550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-dc7481b4-cbd5-4a62-b3e3-6bfa4550f875 req-9e29c2b3-e2dc-4957-8462-a7c991bb8ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea02907-af21-408e-b7cd-71affdf8ae02", "name": "network-vif-plugged", "status": "completed", "tag": "2900dc08-dc75-41a3-8205-a188e5ca497e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:31.317561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dc7481b4-cbd5-4a62-b3e3-6bfa4550f875 req-9e29c2b3-e2dc-4957-8462-a7c991bb8ca4 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.318034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dc7481b4-cbd5-4a62-b3e3-6bfa4550f875 req-9e29c2b3-e2dc-4957-8462-a7c991bb8ca4 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.318486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dc7481b4-cbd5-4a62-b3e3-6bfa4550f875 req-9e29c2b3-e2dc-4957-8462-a7c991bb8ca4 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.338674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-dc7481b4-cbd5-4a62-b3e3-6bfa4550f875 req-9e29c2b3-e2dc-4957-8462-a7c991bb8ca4 service nova] Creating event network-vif-plugged:2900dc08-dc75-41a3-8205-a188e5ca497e for instance 8ea02907-af21-408e-b7cd-71affdf8ae02 on hv-cinder-maste Oct 02 01:00:31.349225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-dc7481b4-cbd5-4a62-b3e3-6bfa4550f875 req-9e29c2b3-e2dc-4957-8462-a7c991bb8ca4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046119 Oct 02 01:00:31.350159 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 329/658] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:31.571479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:31.572013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:31.578841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.579338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.579783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.580487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:31.580944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:31.581374 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:31.732417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:31.734743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:31.742210 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:31.743681 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:31.744925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c07f5b0b-af69-4472-ab87-98baa5593dac tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.177601 Oct 02 01:00:31.745489 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 330/659] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:31 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:32.270190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:32.271611 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:32.281886 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.282584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.282966 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.284506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.284961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.285380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.423228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:32.432602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2fa2c93e-cada-4172-b23b-2ee9906a2573 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.166387 Oct 02 01:00:32.443012 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 330/660] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:32 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:32.519101 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a08a919f-a24a-4e9d-bd67-1cc5f78b78bf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3b89541-76aa-4d60-9c94-9b007bf9e3e2"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:32.521576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a08a919f-a24a-4e9d-bd67-1cc5f78b78bf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:32.530513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a08a919f-a24a-4e9d-bd67-1cc5f78b78bf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.531039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a08a919f-a24a-4e9d-bd67-1cc5f78b78bf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.531438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a08a919f-a24a-4e9d-bd67-1cc5f78b78bf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.532297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a08a919f-a24a-4e9d-bd67-1cc5f78b78bf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.532814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a08a919f-a24a-4e9d-bd67-1cc5f78b78bf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.533182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a08a919f-a24a-4e9d-bd67-1cc5f78b78bf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.770601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:32.771239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:32.777195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.777670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.778127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.778812 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:32.779263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:32.779684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:32.924164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:32.933588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:32.935445 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:32.936799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b62e3a9-1ef6-436c-9a4b-e14cec339b67 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.170111 Oct 02 01:00:32.937355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 331/661] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:32 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:33.456615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:33.457320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:33.464655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:33.465412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:33.466011 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:33.466894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:33.467505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:33.468097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:33.605213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:33.613278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a56f797b-1d1e-4f52-b0b4-c16faa0d8c9a tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.161014 Oct 02 01:00:33.613845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 332/662] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:33.963624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:33.964965 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:33.971232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:33.971811 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:33.972256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:33.974117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:33.974117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:33.974117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:34.128527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:34.137432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:34.138917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:34.140088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa1d743a-38ac-4583-aba7-dfecf77553b9 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.180398 Oct 02 01:00:34.152176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 333/663] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:33 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:34.644727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:34.646266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:34.653352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:34.654200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:34.654877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:34.656335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:34.657013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:34.657658 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:34.803481 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:34.811160 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36a55243-f648-437c-8155-815568a89441 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.170185 Oct 02 01:00:34.811727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 334/664] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:34 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:35.164934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:35.165539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:35.171590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:35.172074 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:35.172504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:35.173191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:35.173639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:35.174069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:35.309544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:35.323493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:35.325550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:35.327058 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3674c8c-26ca-48b6-b9cc-31924a48c57b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.166034 Oct 02 01:00:35.329474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 335/665] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:35 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:35.834121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:35.834739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:35.841648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:35.842161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:35.842593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:35.843273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:35.843723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:35.844145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:35.863856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:00:36.002669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:36.012343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a555bac8-ab5c-4402-a6ee-3127bae6e736 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.182016 Oct 02 01:00:36.013216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 336/666] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:35 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:36.353128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:36.354173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:36.361918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:36.362513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:36.362942 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:36.363637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:36.364079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:36.364502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:36.508817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:36.517832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:36.519312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:36.520468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bbede323-fcc9-40b5-8a1d-98a5a16b823b tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.171780 Oct 02 01:00:36.521026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 337/667] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:36 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:37.035740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:37.042625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:37.052981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.053704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.054605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.055834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.056302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.057402 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.201884 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:37.209793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5daec474-dff2-49c8-a19d-94008e3fce29 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.178760 Oct 02 01:00:37.210388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 338/668] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:37 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:37.545240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:37.545843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:37.551759 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.552234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.552663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.553339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:37.553785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:37.554238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:37.679342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:37.687468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:37.688897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:37.690156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-701d403c-4382-4906-85b1-18d39827a835 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.149382 Oct 02 01:00:37.690710 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 339/669] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:37 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:38.049487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a08a919f-a24a-4e9d-bd67-1cc5f78b78bf tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.534187 Oct 02 01:00:38.050123 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 331/670] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:00:32 2022] POST /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments => generated 194 bytes in 5536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:38.232523 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:38.233059 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:38.239381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:38.239854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:38.240284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:38.241224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:38.241671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:38.242105 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:38.368698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:38.377494 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb38025d-6ef7-4e9e-8bfb-38010999e4e6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.148961 Oct 02 01:00:38.378077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 340/671] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:38 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:38.716709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:38.717405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:38.723549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:38.724025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:38.724460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:38.725144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:38.725596 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:38.726022 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:38.873642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:38.883037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:38.884488 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:38.885640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-67d56108-9be8-4d8d-b6dc-28b4cd266e7f tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.173734 Oct 02 01:00:38.886417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 332/672] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:38 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:39.400037 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:39.401267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:39.407748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.408211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.408642 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.409340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.409779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.410234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.539999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:39.547543 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f5b4b724-2cc8-4e07-b037-879ac7d15a1f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.151367 Oct 02 01:00:39.548123 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 341/673] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:39 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:39.912173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:39.912776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:39.920090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.920568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.920998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:39.922171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:39.922626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:39.923046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:40.049239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:40.057802 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:40.059277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:40.060409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4d63c808-9539-44e8-a890-095aad0a9af0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.152425 Oct 02 01:00:40.060963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 333/674] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:39 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:40.570324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:40.571147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:40.577820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:40.578342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:40.578840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:40.579629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:40.580218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:40.580591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:40.714970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:40.722448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a7450c7-f827-49a1-ac69-9d40abe4199f tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1314 microversion: 2.1 time: 0.155950 Oct 02 01:00:40.723002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 342/675] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:40 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:41.085560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:41.086305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:41.092513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:41.092994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:41.093422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:41.094128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:41.094577 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:41.094999 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:41.223920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:41.232790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:41.234294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:41.235659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-434e77f6-b756-40bd-9dea-b47f50f87ee2 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.154032 Oct 02 01:00:41.236216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 334/676] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:41 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:41.746340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:41.746948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:41.753195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:41.753671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:41.754114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:41.754798 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:41.755242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:41.755741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:41.881832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:41.889479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ecf75e97-ca35-45f6-8c72-530adb219112 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1497 microversion: 2.1 time: 0.147717 Oct 02 01:00:41.890040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 343/677] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:41 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:42.264663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:42.265317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:42.272437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.272874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.273319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.274283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.274746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.275841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.417651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:42.425816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:42.427419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:42.428574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ab585f18-1156-4dda-85d1-7c39b02bf983 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.170185 Oct 02 01:00:42.429150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 335/678] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:42 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:42.549676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:42.550220 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:42.556663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.557142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.557577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.558296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.558749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.559173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.583614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:00:42.657134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8c25887-c4bb-4cf4-8098-fc98e2c8847c tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 204 len: 0 microversion: 2.1 time: 0.110883 Oct 02 01:00:42.657730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 344/679] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:00:42 2022] DELETE /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:00:42.666490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:42.667107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:42.672979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.673468 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.673907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.674630 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:42.675089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:42.675519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:42.805410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:42.813602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5fa3b3fe-69a8-44cb-87d1-fb3d301913e2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1503 microversion: 2.1 time: 0.151000 Oct 02 01:00:42.814264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 336/680] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:42 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:43.198590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e072ec50-1d84-4388-a200-ff4863cf5ba4 req-e9224b65-4e54-414b-a411-72a68e25259a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807f29b0-19d4-4261-a69d-4c78413bc735", "name": "network-vif-plugged", "status": "completed", "tag": "5bb807a1-782e-4eeb-9592-d5bfdff8af48"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:43.210614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e072ec50-1d84-4388-a200-ff4863cf5ba4 req-e9224b65-4e54-414b-a411-72a68e25259a service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.211097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e072ec50-1d84-4388-a200-ff4863cf5ba4 req-e9224b65-4e54-414b-a411-72a68e25259a service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.211525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e072ec50-1d84-4388-a200-ff4863cf5ba4 req-e9224b65-4e54-414b-a411-72a68e25259a service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:43.223036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e072ec50-1d84-4388-a200-ff4863cf5ba4 req-e9224b65-4e54-414b-a411-72a68e25259a service nova] Creating event network-vif-plugged:5bb807a1-782e-4eeb-9592-d5bfdff8af48 for instance 807f29b0-19d4-4261-a69d-4c78413bc735 on hv-cinder-maste Oct 02 01:00:43.228580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e072ec50-1d84-4388-a200-ff4863cf5ba4 req-e9224b65-4e54-414b-a411-72a68e25259a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Oct 02 01:00:43.229170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 345/681] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:43.454761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:43.455378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:43.461819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.462850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.463288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:43.463976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.464432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.464856 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:43.592664 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:43.600741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:43.602259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:43.603967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f95c2514-a469-4eed-a2ea-852754d0a28e tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.152413 Oct 02 01:00:43.604526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 337/682] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:43 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 02 01:00:43.838222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:43.838925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:43.845046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.845523 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.845952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:43.846662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:43.847111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:43.847535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:43.984924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:43.996188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8adc7f0b-ba62-4864-b48d-de7fdd1157d6 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1503 microversion: 2.1 time: 0.163059 Oct 02 01:00:43.997095 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 346/683] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:43 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:44.628752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:44.629395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:44.635734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:44.636212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:44.636643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:44.637340 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:44.637793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:44.638248 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:44.825388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:44.833609 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:44.835101 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:44.836255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-17426d91-b492-476a-9417-762913be2eb0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.211421 Oct 02 01:00:44.836819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 338/684] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:44 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:44.930294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-509fee1e-189e-4eb7-a155-f476cf95883a req-55a45fca-6db5-43a7-b913-8db78bbcd318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea02907-af21-408e-b7cd-71affdf8ae02", "name": "network-vif-deleted", "tag": "2900dc08-dc75-41a3-8205-a188e5ca497e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:44.940124 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-509fee1e-189e-4eb7-a155-f476cf95883a req-55a45fca-6db5-43a7-b913-8db78bbcd318 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:44.940604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-509fee1e-189e-4eb7-a155-f476cf95883a req-55a45fca-6db5-43a7-b913-8db78bbcd318 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:44.941036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-509fee1e-189e-4eb7-a155-f476cf95883a req-55a45fca-6db5-43a7-b913-8db78bbcd318 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:44.951950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-509fee1e-189e-4eb7-a155-f476cf95883a req-55a45fca-6db5-43a7-b913-8db78bbcd318 service nova] Creating event network-vif-deleted:2900dc08-dc75-41a3-8205-a188e5ca497e for instance 8ea02907-af21-408e-b7cd-71affdf8ae02 on hv-cinder-maste Oct 02 01:00:44.956677 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-509fee1e-189e-4eb7-a155-f476cf95883a req-55a45fca-6db5-43a7-b913-8db78bbcd318 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030091 Oct 02 01:00:44.957254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 347/685] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:00:45.019795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.020458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:45.026851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.027345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.027782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.028491 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.028951 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.029394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.091259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:45.099068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3b9e7b28-491c-4dc8-ae1a-a806f1c04a27 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1461 microversion: 2.1 time: 0.083189 Oct 02 01:00:45.099638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 339/686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1461 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:45.862385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:45.863111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:45.870293 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.870776 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.871211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:45.871896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:45.872349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:45.872773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:46.016441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:46.024931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:46.026512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:46.028973 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-91850be9-ed18-4cfe-9f43-46d710e37a30 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1728 microversion: 2.20 time: 0.170817 Oct 02 01:00:46.029517 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 348/687] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:45 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:46.123235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:46.123725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:46.130143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:46.130678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:46.131034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:46.131721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:46.132365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:46.132579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:46.166430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:46.166916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:46.167350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:46.167794 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lazy-loading 'fault' on Instance uuid 8ea02907-af21-408e-b7cd-71affdf8ae02 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:00:46.208598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:46.216934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-18ff61db-3d9c-4dc6-98ca-a90b827ce314 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1304 microversion: 2.1 time: 0.098204 Oct 02 01:00:46.224383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 340/688] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:46 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:00:47.054743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:47.055452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:47.062735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.063212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.063643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.064335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.064811 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.065228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.240948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:47.242355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:47.249653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.250195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.250632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.251331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.252052 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.252476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.286859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.287245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.287674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.288308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lazy-loading 'fault' on Instance uuid 8ea02907-af21-408e-b7cd-71affdf8ae02 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:00:47.300708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:47.310574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:47.312075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:47.313737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ccc428f-4be8-493e-82c9-620c4f78aed8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1715 microversion: 2.20 time: 0.262881 Oct 02 01:00:47.314484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 349/689] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:00:47 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1715 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:00:47.334703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9426abb5e495ea34429a5cccf9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4519c281444cec82120fc744a4c5f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:00:47.343117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bf851a74-cb29-48fa-b768-7ec1c0c74aa2 tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 200 len: 1304 microversion: 2.1 time: 0.106116 Oct 02 01:00:47.343725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 341/690] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:47 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:00:47.698555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-068cec31-17cf-4600-aa7d-72e7ea04ab3e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:47.700798 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-068cec31-17cf-4600-aa7d-72e7ea04ab3e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:47.706679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-068cec31-17cf-4600-aa7d-72e7ea04ab3e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.707152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-068cec31-17cf-4600-aa7d-72e7ea04ab3e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.707574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-068cec31-17cf-4600-aa7d-72e7ea04ab3e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.708249 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-068cec31-17cf-4600-aa7d-72e7ea04ab3e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.708693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-068cec31-17cf-4600-aa7d-72e7ea04ab3e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.709110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-068cec31-17cf-4600-aa7d-72e7ea04ab3e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.739771 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-068cec31-17cf-4600-aa7d-72e7ea04ab3e tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Oct 02 01:00:47.740314 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 350/691] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:00:47 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:47.751735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e7fa0037-c560-4935-b149-544c9729bff3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:47.752230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e7fa0037-c560-4935-b149-544c9729bff3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:47.758027 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7fa0037-c560-4935-b149-544c9729bff3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.758541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7fa0037-c560-4935-b149-544c9729bff3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.758979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7fa0037-c560-4935-b149-544c9729bff3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.759665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7fa0037-c560-4935-b149-544c9729bff3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:47.760115 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7fa0037-c560-4935-b149-544c9729bff3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:47.760537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e7fa0037-c560-4935-b149-544c9729bff3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:47.789901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e7fa0037-c560-4935-b149-544c9729bff3 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d3b89541-76aa-4d60-9c94-9b007bf9e3e2" status: 200 len: 194 microversion: 2.1 time: 0.042014 Oct 02 01:00:47.791142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 342/692] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Oct 2 01:00:47 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d3b89541-76aa-4d60-9c94-9b007bf9e3e2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:00:48.371830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:00:48.372348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] [instance: 8ea02907-af21-408e-b7cd-71affdf8ae02] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:48.378758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:48.379229 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:48.379693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:48.380391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:48.380847 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:48.381301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:48.395076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] HTTP exception thrown: Instance 8ea02907-af21-408e-b7cd-71affdf8ae02 could not be found. Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Request method failure captured: Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 HTTP/1.1 Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOKO69RgLvANnB03OA2yte3396VUrIcFafB7ncGolw77Sbr5MAHBaEqMUSM91oJkwKG4KXozBPcjTZrotPFum-AyO65OTRPw_2tEcwIGM3EqkTfHdx7_TZNGRqqhnVl6L1MX85c6kbp5TBMyLASYVF4J5xxf6kUk4ky2XgmAwI7xiyw Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 3b4519c281444cec82120fc744a4c5f0 Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesActionsTest-1723336818 Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:00:48.396679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b4519c281444cec82120fc744a4c5f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3b4519c281444cec82120fc744a4c5f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3b4519c281444cec82120fc744a4c5f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b4519c281444cec82120fc744a4c5f0"}]}] Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesActionsTest-1723336818 Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 3b4519c281444cec82120fc744a4c5f0 Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesActionsTest-1723336818 Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesActionsTest-1723336818-project Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 0df9426abb5e495ea34429a5cccf9fe4 Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesActionsTest-1723336818-project Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 8ea02907-af21-408e-b7cd-71affdf8ae02 could not be found. Oct 02 01:00:48.398260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '8ea02907-af21-408e-b7cd-71affdf8ae02'} Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea02907-af21-408e-b7cd-71affdf8ae02 could not be found. Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:00:48.399127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea02907-af21-408e-b7cd-71affdf8ae02 could not be found. Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea02907-af21-408e-b7cd-71affdf8ae02 could not be found. Oct 02 01:00:48.401298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:00:48.402899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] Returning 404 to user: Instance 8ea02907-af21-408e-b7cd-71affdf8ae02 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:00:48.402899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c98a3a7-611d-41f3-bec7-4cb9ca26484d tempest-VolumesActionsTest-1723336818 tempest-VolumesActionsTest-1723336818-project] 10.222.0.25 "GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02" status: 404 len: 111 microversion: 2.1 time: 0.030158 Oct 02 01:00:48.402899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 351/693] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:00:48 2022] GET /compute/v2.1/servers/8ea02907-af21-408e-b7cd-71affdf8ae02 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:00:49.137662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-154d0694-b9e5-4a6d-8b06-04c8d11e8258 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1d0d8e3-9b15-4fc0-acfe-4f6a73839b29"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:00:49.140396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-154d0694-b9e5-4a6d-8b06-04c8d11e8258 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:00:49.146846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-154d0694-b9e5-4a6d-8b06-04c8d11e8258 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:49.147332 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-154d0694-b9e5-4a6d-8b06-04c8d11e8258 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:49.147758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-154d0694-b9e5-4a6d-8b06-04c8d11e8258 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:49.148448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-154d0694-b9e5-4a6d-8b06-04c8d11e8258 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:00:49.148895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-154d0694-b9e5-4a6d-8b06-04c8d11e8258 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:00:49.149313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-154d0694-b9e5-4a6d-8b06-04c8d11e8258 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:00:49.405959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-154d0694-b9e5-4a6d-8b06-04c8d11e8258 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "POST /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273493 Oct 02 01:00:49.406655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 343/694] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:00:49 2022] POST /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:00.188167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-034f777d-7132-4082-aba4-ec03f697cbb1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:00.191306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-034f777d-7132-4082-aba4-ec03f697cbb1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:00.194393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:00.195028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:00.201016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034f777d-7132-4082-aba4-ec03f697cbb1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.201518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034f777d-7132-4082-aba4-ec03f697cbb1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.201954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034f777d-7132-4082-aba4-ec03f697cbb1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.202759 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034f777d-7132-4082-aba4-ec03f697cbb1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.203214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034f777d-7132-4082-aba4-ec03f697cbb1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.203669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-034f777d-7132-4082-aba4-ec03f697cbb1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.239194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-034f777d-7132-4082-aba4-ec03f697cbb1 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057256 Oct 02 01:01:00.239800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 352/695] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:01:00 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:00.387919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:00.388693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:00.393188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-13331cb8-7c7f-432e-9720-dd068f01fad9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:00.393779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-13331cb8-7c7f-432e-9720-dd068f01fad9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:00.411550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13331cb8-7c7f-432e-9720-dd068f01fad9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.412372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13331cb8-7c7f-432e-9720-dd068f01fad9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.413173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13331cb8-7c7f-432e-9720-dd068f01fad9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.413986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13331cb8-7c7f-432e-9720-dd068f01fad9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.414595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13331cb8-7c7f-432e-9720-dd068f01fad9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.415108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13331cb8-7c7f-432e-9720-dd068f01fad9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.449362 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-13331cb8-7c7f-432e-9720-dd068f01fad9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d3b89541-76aa-4d60-9c94-9b007bf9e3e2" status: 200 len: 194 microversion: 2.1 time: 0.063536 Oct 02 01:01:00.449959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 344/696] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Oct 2 01:01:00 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d3b89541-76aa-4d60-9c94-9b007bf9e3e2 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:00.460446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:00.460960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:00.468072 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.468563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.469007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.469706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:00.470206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:00.470638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:00.580474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lazy-loading 'services' on Instance uuid 609b6fb8-9eec-425d-b7f5-c31300a22be3 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:00.670438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5e70494-e7b9-47cd-b6d6-542bedcb7b69 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "DELETE /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d3b89541-76aa-4d60-9c94-9b007bf9e3e2" status: 202 len: 0 microversion: 2.1 time: 0.213562 Oct 02 01:01:00.671188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 353/697] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 01:01:00 2022] DELETE /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d3b89541-76aa-4d60-9c94-9b007bf9e3e2 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:02.892239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f9b34997-5df6-42b5-a809-51ec083b84a8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:02.893423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f9b34997-5df6-42b5-a809-51ec083b84a8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:02.903518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9b34997-5df6-42b5-a809-51ec083b84a8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:02.904013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9b34997-5df6-42b5-a809-51ec083b84a8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:02.904592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9b34997-5df6-42b5-a809-51ec083b84a8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:02.905311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9b34997-5df6-42b5-a809-51ec083b84a8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:02.905770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9b34997-5df6-42b5-a809-51ec083b84a8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:02.906268 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f9b34997-5df6-42b5-a809-51ec083b84a8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:02.938930 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f9b34997-5df6-42b5-a809-51ec083b84a8 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d1d0d8e3-9b15-4fc0-acfe-4f6a73839b29" status: 200 len: 194 microversion: 2.1 time: 0.050815 Oct 02 01:01:02.942143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 345/698] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Oct 2 01:01:02 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d1d0d8e3-9b15-4fc0-acfe-4f6a73839b29 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:02.952152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:02.952733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:02.960496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:02.960985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:02.963897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:02.963897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:02.963897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:02.964196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:03.060172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lazy-loading 'services' on Instance uuid 609b6fb8-9eec-425d-b7f5-c31300a22be3 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:03.141474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57c22877-4b45-45c1-b34f-c19884f78da9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "DELETE /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d1d0d8e3-9b15-4fc0-acfe-4f6a73839b29" status: 202 len: 0 microversion: 2.1 time: 0.194022 Oct 02 01:01:03.142113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 354/699] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 01:01:02 2022] DELETE /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments/d1d0d8e3-9b15-4fc0-acfe-4f6a73839b29 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:04.349178 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e5e0b770-b115-4a37-80c8-fa5f1ea8e050 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.351700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e5e0b770-b115-4a37-80c8-fa5f1ea8e050 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:04.363306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5e0b770-b115-4a37-80c8-fa5f1ea8e050 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.364007 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5e0b770-b115-4a37-80c8-fa5f1ea8e050 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.364528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5e0b770-b115-4a37-80c8-fa5f1ea8e050 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.365654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5e0b770-b115-4a37-80c8-fa5f1ea8e050 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.366255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5e0b770-b115-4a37-80c8-fa5f1ea8e050 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.366767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5e0b770-b115-4a37-80c8-fa5f1ea8e050 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.424593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e5e0b770-b115-4a37-80c8-fa5f1ea8e050 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079382 Oct 02 01:01:04.425192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 346/700] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:04.554865 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-340fe836-1c9e-451d-bc2c-0eb563a4b9f5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.557150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-340fe836-1c9e-451d-bc2c-0eb563a4b9f5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:04.564385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-340fe836-1c9e-451d-bc2c-0eb563a4b9f5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.565241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-340fe836-1c9e-451d-bc2c-0eb563a4b9f5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.566218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-340fe836-1c9e-451d-bc2c-0eb563a4b9f5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.567473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-340fe836-1c9e-451d-bc2c-0eb563a4b9f5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.568287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-340fe836-1c9e-451d-bc2c-0eb563a4b9f5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.568933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-340fe836-1c9e-451d-bc2c-0eb563a4b9f5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.604789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-340fe836-1c9e-451d-bc2c-0eb563a4b9f5 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054189 Oct 02 01:01:04.605469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 355/701] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:01:04.675006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.676064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:04.684213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.684852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.685467 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.686444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.686891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.687506 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.721729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:01:04.818608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-40e4898a-9b66-4b38-be51-89aa9bcab2fb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "DELETE /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 204 len: 0 microversion: 2.1 time: 0.145730 Oct 02 01:01:04.821834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 347/702] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:04 2022] DELETE /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:04.827826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:04.828432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:04.835953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.835953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.835953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.836700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:04.837055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:04.838030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:04.983474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:04.991815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d91f557-9b02-4cfc-be9b-1eb1bb67d0f7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1674 microversion: 2.1 time: 0.168481 Oct 02 01:01:04.992436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 356/703] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:04 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:06.016501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:06.017897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:06.025102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:06.025906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:06.026661 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:06.027656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:06.028352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:06.028998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:06.186975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:06.196247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-05b5844a-6896-4ec7-903d-56dfde9bbdbb tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1674 microversion: 2.1 time: 0.183169 Oct 02 01:01:06.214083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 348/704] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:06 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:07.223986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:07.224752 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:07.236868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:07.238786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:07.239967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:07.241347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:07.241913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:07.243070 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:07.477099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:07.486346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-faf5eff8-1ca8-4dfc-80a0-aab1dc8cddcd tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1674 microversion: 2.1 time: 0.267396 Oct 02 01:01:07.487292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 357/705] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:07 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1674 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:08.178102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-71a287ab-8648-45e5-8388-d84464d115ce req-37ecbc8e-ff4b-4d77-b420-e4102f637222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609b6fb8-9eec-425d-b7f5-c31300a22be3", "name": "network-vif-deleted", "tag": "9ff52132-5987-4860-b37d-9bb381e4ed44"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:08.189388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-71a287ab-8648-45e5-8388-d84464d115ce req-37ecbc8e-ff4b-4d77-b420-e4102f637222 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.190256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-71a287ab-8648-45e5-8388-d84464d115ce req-37ecbc8e-ff4b-4d77-b420-e4102f637222 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.190752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-71a287ab-8648-45e5-8388-d84464d115ce req-37ecbc8e-ff4b-4d77-b420-e4102f637222 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.213109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-71a287ab-8648-45e5-8388-d84464d115ce req-37ecbc8e-ff4b-4d77-b420-e4102f637222 service nova] Creating event network-vif-deleted:9ff52132-5987-4860-b37d-9bb381e4ed44 for instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 on hv-cinder-maste Oct 02 01:01:08.225301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-71a287ab-8648-45e5-8388-d84464d115ce req-37ecbc8e-ff4b-4d77-b420-e4102f637222 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051468 Oct 02 01:01:08.225950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 349/706] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:08.513032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:08.513635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:08.520068 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.520543 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.520973 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.521654 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.522127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.522553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.554567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:08.555653 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:08.556093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:08.556537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lazy-loading 'fault' on Instance uuid 609b6fb8-9eec-425d-b7f5-c31300a22be3 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:08.597949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6415bc1076204c78ad819ab2836a3652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f218a688a41ab9e06269c4be3973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:08.606792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0fbf94ef-04a7-4f26-bb71-7e7f6c616c72 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 200 len: 1328 microversion: 2.1 time: 0.097575 Oct 02 01:01:08.607353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 358/707] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:08 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:09.631503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:09.632205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:09.639033 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.639516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.639956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.640656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:09.641114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:09.641545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:09.654454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] HTTP exception thrown: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Request method failure captured: Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 HTTP/1.1 Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOGyLS7_TgH1f4o70XntOFVJsQTSBZjS0Vm2JCkci2Se2vm6p8s3Wa-JBzX8M2T4VUd2me-xnhUV0lcmzSItMAc7lZY0aEsMcdLtFJUVoN0lN36UnW4BFLrEejwpis10xDoKu-H-2AnVL9poBqvM2z5zUoxJhsRBhldIUiIKyDobHfs Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:01:09.656058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}] Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 6415bc1076204c78ad819ab2836a3652 Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:09.657628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '609b6fb8-9eec-425d-b7f5-c31300a22be3'} Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:09.658568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:09.660094 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:09.661424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Returning 404 to user: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:09.661424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c467d732-e0a7-4eec-bb14-327d6db2bbc9 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 404 len: 111 microversion: 2.1 time: 0.030649 Oct 02 01:01:09.661424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 350/708] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:09 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:09.666158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c2797cb7-747f-4296-8f82-cd00bce4d188 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '.version_select at 0x7f6e78e57280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:09.685039 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c2797cb7-747f-4296-8f82-cd00bce4d188 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360192824" status: 202 len: 0 microversion: 2.1 time: 0.022721 Oct 02 01:01:09.685724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 359/709] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Oct 2 01:01:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360192824 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:12.548657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:12.549167 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:12.556022 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:12.556511 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:12.556944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:12.557668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:12.558160 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:12.558596 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:12.572432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] HTTP exception thrown: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Request method failure captured: Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 HTTP/1.1 Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOGyLS7_TgH1f4o70XntOFVJsQTSBZjS0Vm2JCkci2Se2vm6p8s3Wa-JBzX8M2T4VUd2me-xnhUV0lcmzSItMAc7lZY0aEsMcdLtFJUVoN0lN36UnW4BFLrEejwpis10xDoKu-H-2AnVL9poBqvM2z5zUoxJhsRBhldIUiIKyDobHfs Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:01:12.573984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}] Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 6415bc1076204c78ad819ab2836a3652 Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.575644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '609b6fb8-9eec-425d-b7f5-c31300a22be3'} Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:12.576732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.578272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.579918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Returning 404 to user: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:12.579918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-005d0c6c-020e-4d23-9a9b-3838f62cdbc4 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "DELETE /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 404 len: 111 microversion: 2.1 time: 0.031003 Oct 02 01:01:12.579918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 351/710] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:12 2022] DELETE /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:12.584408 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:12.585018 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 609b6fb8-9eec-425d-b7f5-c31300a22be3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:12.592676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:12.593153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:12.593589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:12.594298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:12.594751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:12.595169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:12.608418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] HTTP exception thrown: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Request method failure captured: Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 HTTP/1.1 Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOGyLS7_TgH1f4o70XntOFVJsQTSBZjS0Vm2JCkci2Se2vm6p8s3Wa-JBzX8M2T4VUd2me-xnhUV0lcmzSItMAc7lZY0aEsMcdLtFJUVoN0lN36UnW4BFLrEejwpis10xDoKu-H-2AnVL9poBqvM2z5zUoxJhsRBhldIUiIKyDobHfs Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:01:12.610049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}] Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 6415bc1076204c78ad819ab2836a3652 Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.611748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '609b6fb8-9eec-425d-b7f5-c31300a22be3'} Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:12.612793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. Oct 02 01:01:12.614286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:12.615817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Returning 404 to user: Instance 609b6fb8-9eec-425d-b7f5-c31300a22be3 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:12.615817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e0aa39d-b687-47e9-aa96-1f7b7c786e63 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3" status: 404 len: 111 microversion: 2.1 time: 0.030830 Oct 02 01:01:12.615817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 360/711] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:12 2022] GET /compute/v2.1/servers/609b6fb8-9eec-425d-b7f5-c31300a22be3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:01:13.749633 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:13.750154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:13.756463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:13.756945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:13.757378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:13.758110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:13.758564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:13.758984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:13.772257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] HTTP exception thrown: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Request method failure captured: Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 HTTP/1.1 Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOGyLS7_TgH1f4o70XntOFVJsQTSBZjS0Vm2JCkci2Se2vm6p8s3Wa-JBzX8M2T4VUd2me-xnhUV0lcmzSItMAc7lZY0aEsMcdLtFJUVoN0lN36UnW4BFLrEejwpis10xDoKu-H-2AnVL9poBqvM2z5zUoxJhsRBhldIUiIKyDobHfs Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:01:13.773819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}] Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 6415bc1076204c78ad819ab2836a3652 Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.775360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '1f31c21f-46c0-4906-b0fd-ca8fb00439e8'} Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:13.776163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.777541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.778944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Returning 404 to user: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:13.778944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7cde8eea-445a-4c0b-874d-1ad6cd57b0e7 tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 404 len: 111 microversion: 2.1 time: 0.029406 Oct 02 01:01:13.778944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 352/712] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:13 2022] DELETE /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:13.783526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:13.784235 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] [instance: 1f31c21f-46c0-4906-b0fd-ca8fb00439e8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:13.791212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:13.791690 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:13.792147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:13.792898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:13.793349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:13.793773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:13.807691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] HTTP exception thrown: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Request method failure captured: Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 HTTP/1.1 Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOGyLS7_TgH1f4o70XntOFVJsQTSBZjS0Vm2JCkci2Se2vm6p8s3Wa-JBzX8M2T4VUd2me-xnhUV0lcmzSItMAc7lZY0aEsMcdLtFJUVoN0lN36UnW4BFLrEejwpis10xDoKu-H-2AnVL9poBqvM2z5zUoxJhsRBhldIUiIKyDobHfs Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:01:13.809129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f2f218a688a41ab9e06269c4be3973d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f2f218a688a41ab9e06269c4be3973d"}]}] Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 6f2f218a688a41ab9e06269c4be3973d Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2110823758 Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 6415bc1076204c78ad819ab2836a3652 Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeTestJSON-2110823758-project Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.810743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '1f31c21f-46c0-4906-b0fd-ca8fb00439e8'} Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:13.811533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. Oct 02 01:01:13.812686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:13.813730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] Returning 404 to user: Instance 1f31c21f-46c0-4906-b0fd-ca8fb00439e8 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:13.813730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9e9ebf7-188b-48b8-87cf-14aeb63ea33c tempest-AttachVolumeTestJSON-2110823758 tempest-AttachVolumeTestJSON-2110823758-project] 10.222.0.25 "GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8" status: 404 len: 111 microversion: 2.1 time: 0.030782 Oct 02 01:01:13.813730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 361/713] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:13 2022] GET /compute/v2.1/servers/1f31c21f-46c0-4906-b0fd-ca8fb00439e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:22.685020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2bd942ac-2550-447d-a496-2c833c6d949c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: .version_select at 0x7f6e78e853a0>, body: {"keypair": {"name": "tempest-keypair-467545146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm9b3I16DDG+VSsczEIeds7pnvIo6Yp7IkI0Q7GXsJK9bINIIq0UHRNP0cgkcXEf/p3xXdc3kgDVJ9A1CEpKgJ2QxcSgDgIE0fGOSWfH49JMp+9zHVvyhzKPWKVXzUJ0w=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:22.700107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-2bd942ac-2550-447d-a496-2c833c6d949c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for project 29870f31b41846cc923a28ebfaf368db. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:22.704367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-2bd942ac-2550-447d-a496-2c833c6d949c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for user 1750f2cc69c0499ebade616da183507b and project 29870f31b41846cc923a28ebfaf368db. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:22.732603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2bd942ac-2550-447d-a496-2c833c6d949c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166076 Oct 02 01:01:22.733519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 353/714] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 01:01:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:23.322631 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:23.323486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:23.336773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.337269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.337709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.338454 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.338907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.345642 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.417689 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:01:23.442092 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-f3d3c8e9-3b07-45d5-b512-3230001b38a7 req-cc20a60a-2ae1-4910-9955-ac05f15d383f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb223bc-04ab-40a1-91da-3a3900ed7c11", "tag": "35dfa250-2a82-4094-bfb8-cf1ecf3f6a10"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:23.466443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f3d3c8e9-3b07-45d5-b512-3230001b38a7 req-cc20a60a-2ae1-4910-9955-ac05f15d383f service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.475122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f3d3c8e9-3b07-45d5-b512-3230001b38a7 req-cc20a60a-2ae1-4910-9955-ac05f15d383f service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.475683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-f3d3c8e9-3b07-45d5-b512-3230001b38a7 req-cc20a60a-2ae1-4910-9955-ac05f15d383f service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.507135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-f3d3c8e9-3b07-45d5-b512-3230001b38a7 req-cc20a60a-2ae1-4910-9955-ac05f15d383f service nova] Creating event network-changed:35dfa250-2a82-4094-bfb8-cf1ecf3f6a10 for instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 on hv-cinder-maste Oct 02 01:01:23.525228 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-f3d3c8e9-3b07-45d5-b512-3230001b38a7 req-cc20a60a-2ae1-4910-9955-ac05f15d383f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201520 Oct 02 01:01:23.529599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 354/715] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:23.539643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb0d1551-5fac-4a36-b025-3e637ebd9f20 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 204 len: 0 microversion: 2.1 time: 0.222565 Oct 02 01:01:23.540452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 362/716] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:01:23 2022] DELETE /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:01:23.549552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:23.550384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:23.557901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.558513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.559193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.560109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:23.560758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:23.562287 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:23.875771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:23.891196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aa796006-7625-48e6-b42d-c971bef39536 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.341954 Oct 02 01:01:23.893259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 355/717] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:23 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:24.495955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1046883025", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "187441bc-85a8-46c2-a472-a2fcaf6bcd79"}], "security_groups": [{"name": "tempest-securitygroup--1226614913"}], "key_name": "tempest-keypair-467545146", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:24.619907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] validate_networks() for [('187441bc-85a8-46c2-a472-a2fcaf6bcd79', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:24.921203 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:24.921819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:24.933662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.940739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.941684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:24.943093 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:24.944006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:24.944590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.221723 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:25.229932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6d3d6a2a-54a5-4321-af81-7088c18c223b tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1567 microversion: 2.1 time: 0.313418 Oct 02 01:01:25.230733 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 356/718] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:24 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1567 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:25.352717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:25.353347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:25.353825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:25.354265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:25.355096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:25.364290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:25.365195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:25.365635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.366386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:25.367516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:25.368133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:25.386532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for project 29870f31b41846cc923a28ebfaf368db. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:25.393114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for user 1750f2cc69c0499ebade616da183507b and project 29870f31b41846cc923a28ebfaf368db. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:25.407361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:25.409901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:25.463590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eab4dcfc-0a1f-427c-8a6b-7678225fc4f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.973888 Oct 02 01:01:25.464239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 363/719] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:01:25.475809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-edabf4f9-cf96-4800-af12-833ecc194b29 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:25.476797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-edabf4f9-cf96-4800-af12-833ecc194b29 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:25.588660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-edabf4f9-cf96-4800-af12-833ecc194b29 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:25.597888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-edabf4f9-cf96-4800-af12-833ecc194b29 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1241 microversion: 2.1 time: 0.125905 Oct 02 01:01:25.598690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 357/720] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:25 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:26.257207 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.258516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:26.260630 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-1fd0fa47-cb1a-4287-8636-c5bcc3bf7aaf req-976c1bb8-7f52-47ca-b57c-cd4950e12be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb223bc-04ab-40a1-91da-3a3900ed7c11", "name": "network-vif-deleted", "tag": "35dfa250-2a82-4094-bfb8-cf1ecf3f6a10"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:26.276153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.285435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.287024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.289076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.290653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-1fd0fa47-cb1a-4287-8636-c5bcc3bf7aaf req-976c1bb8-7f52-47ca-b57c-cd4950e12be9 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.291405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-1fd0fa47-cb1a-4287-8636-c5bcc3bf7aaf req-976c1bb8-7f52-47ca-b57c-cd4950e12be9 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.291611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-1fd0fa47-cb1a-4287-8636-c5bcc3bf7aaf req-976c1bb8-7f52-47ca-b57c-cd4950e12be9 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.292222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.292471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.337341 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-1fd0fa47-cb1a-4287-8636-c5bcc3bf7aaf req-976c1bb8-7f52-47ca-b57c-cd4950e12be9 service nova] Creating event network-vif-deleted:35dfa250-2a82-4094-bfb8-cf1ecf3f6a10 for instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 on hv-cinder-maste Oct 02 01:01:26.345200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-1fd0fa47-cb1a-4287-8636-c5bcc3bf7aaf req-976c1bb8-7f52-47ca-b57c-cd4950e12be9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087678 Oct 02 01:01:26.347995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 358/721] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:26.364440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-947323c6-ca43-40be-9bb2-7b5760efa950 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.367135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-947323c6-ca43-40be-9bb2-7b5760efa950 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:26.400119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947323c6-ca43-40be-9bb2-7b5760efa950 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.400790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947323c6-ca43-40be-9bb2-7b5760efa950 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.401337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947323c6-ca43-40be-9bb2-7b5760efa950 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.402894 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947323c6-ca43-40be-9bb2-7b5760efa950 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.403655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947323c6-ca43-40be-9bb2-7b5760efa950 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.406154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-947323c6-ca43-40be-9bb2-7b5760efa950 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.416313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.430300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-334e798d-7d25-4acd-baea-90d8577b678e tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1381 microversion: 2.1 time: 0.178372 Oct 02 01:01:26.432833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 364/722] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:26 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1381 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:26.448871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-947323c6-ca43-40be-9bb2-7b5760efa950 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.089606 Oct 02 01:01:26.449735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 359/723] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Oct 2 01:01:26 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:26.514134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.514633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:26.520590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.521083 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.521519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.522348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.522719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.523774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.555237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:01:26.621198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.622139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:26.628074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.628783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.629409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.630345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.630988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.631841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.639165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa84b61d-e548-46ce-a912-41eb857472d8 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 204 len: 0 microversion: 2.20 time: 0.128509 Oct 02 01:01:26.639900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 365/724] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Oct 2 01:01:26 2022] DELETE /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:01:26.650602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:26.652071 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:26.658231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.658760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.659204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.659911 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:26.660488 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:26.660792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:26.684231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:26.713990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.722915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a7f83acc-db18-4d19-afe0-5359e075431a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1293 microversion: 2.1 time: 0.105629 Oct 02 01:01:26.723630 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 360/725] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:26 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:01:26.822392 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.830939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.832366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:26.833506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a868aeab-cf72-425e-8469-221ab9a529a7 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.187769 Oct 02 01:01:26.834051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 366/726] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:26 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:27.455729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.456349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:27.462335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.462822 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.463261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.463957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.464409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.464837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.531705 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:27.540141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7fd74b0c-3b80-44d4-a7ae-de638b34781a tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1219 microversion: 2.1 time: 0.088864 Oct 02 01:01:27.540734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 361/727] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:27 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:27.746631 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.747326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:27.753744 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.754255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.754847 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.755707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.756212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.756698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.825960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:27.833819 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8ae304c-9486-4d7f-a094-de45efc8c96c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1301 microversion: 2.1 time: 0.091020 Oct 02 01:01:27.834643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 367/728] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:27 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:27.859872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:27.860784 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:27.867458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.867919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.868356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.869047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:27.869510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:27.869933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:27.999415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:28.007953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:28.009400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:28.010586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-af743762-6f9c-489f-9883-45a06cfbb035 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.154923 Oct 02 01:01:28.011143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 362/729] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:27 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:28.565350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:28.565350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:28.571105 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.571939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.572560 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.573463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.574113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.574709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.605821 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.606906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.606906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.607207 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lazy-loading 'fault' on Instance uuid 6eb223bc-04ab-40a1-91da-3a3900ed7c11 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:28.669460 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfee7d93eeff4e728abea067c0c42814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302dd84b0b90485691447badb4536c56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:28.677442 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a311a11-5b74-4106-af79-b1fa1e1331f2 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 200 len: 1224 microversion: 2.1 time: 0.118548 Oct 02 01:01:28.678924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 368/730] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:28 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:28.859077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:28.859779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:28.901100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.901655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.902250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:28.903219 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:28.905074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:28.905637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:29.004745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:29.014880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fa681cfd-1406-4539-b4ac-a797e56d1878 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1299 microversion: 2.1 time: 0.159391 Oct 02 01:01:29.015455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 363/731] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:28 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:29.043696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:29.044412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:29.051791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:29.052581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:29.053249 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:29.054742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:29.055436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:29.055934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:29.654516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:29.662634 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:29.664586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:29.665727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0288f5d3-b177-411b-ac79-66b063053f18 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1721 microversion: 2.20 time: 0.628662 Oct 02 01:01:29.666350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 369/732] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:29 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1721 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:29.700726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:29.701365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] [instance: 6eb223bc-04ab-40a1-91da-3a3900ed7c11] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:29.707233 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:29.707717 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:29.708147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:29.708831 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:29.709279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:29.709697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:29.725107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] HTTP exception thrown: Instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 could not be found. Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Request method failure captured: Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 HTTP/1.1 Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOGq3TGDOGLZL8pvUlic4k2FmCMTl8GdiMNYkj5XjsMR2TFjc4iieaBATZBqwv3DoCFy0nr91dcj4b4jHWqnHobgyC4JFSLrxLWz6tfURsMJXBqtFNGt3rkLryit8k1bBa-mFL5frizuoKJEwem3WxMYFtBY_MrrgEZM4FvRkv2KS8g Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 302dd84b0b90485691447badb4536c56 Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-TestShelveInstance-1010328982 Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:01:29.727416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/302dd84b0b90485691447badb4536c56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/302dd84b0b90485691447badb4536c56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_302dd84b0b90485691447badb4536c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/302dd84b0b90485691447badb4536c56"}]}] Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-TestShelveInstance-1010328982 Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 302dd84b0b90485691447badb4536c56 Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-TestShelveInstance-1010328982 Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-TestShelveInstance-1010328982-project Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: bfee7d93eeff4e728abea067c0c42814 Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-TestShelveInstance-1010328982-project Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 could not be found. Oct 02 01:01:29.728919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '6eb223bc-04ab-40a1-91da-3a3900ed7c11'} Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 could not be found. Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:29.729746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 could not be found. Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 could not be found. Oct 02 01:01:29.731026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:29.732141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Returning 404 to user: Instance 6eb223bc-04ab-40a1-91da-3a3900ed7c11 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:29.732141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c6240074-a15c-4032-b501-832608fe7aaa tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11" status: 404 len: 111 microversion: 2.1 time: 0.032319 Oct 02 01:01:29.732141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 364/733] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:29 2022] GET /compute/v2.1/servers/6eb223bc-04ab-40a1-91da-3a3900ed7c11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:01:29.920791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-740025b5-0df6-41da-be19-c11f98084292 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] Calling method '.version_select at 0x7f6e78df8820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:29.958495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-740025b5-0df6-41da-be19-c11f98084292 tempest-TestShelveInstance-1010328982 tempest-TestShelveInstance-1010328982-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-457258283" status: 202 len: 0 microversion: 2.1 time: 0.040172 Oct 02 01:01:29.959795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 370/734] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Oct 2 01:01:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-457258283 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:01:30.051888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:30.052924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:30.064107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.064708 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.065248 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.066300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.066840 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.067283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.096465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:30.410368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:30.420562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cd445cdd-015c-4cab-b4fc-5be42efbaa2f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1367 microversion: 2.1 time: 0.383398 Oct 02 01:01:30.421755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 365/735] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:30 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:30.574126 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ad07b245-3629-4776-8aca-adcb0c3ebbd7 req-687b41a5-b35c-4008-b7cb-fca3647cd3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807f29b0-19d4-4261-a69d-4c78413bc735", "name": "network-vif-deleted", "tag": "5bb807a1-782e-4eeb-9592-d5bfdff8af48"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:30.592795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:30.596750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ad07b245-3629-4776-8aca-adcb0c3ebbd7 req-687b41a5-b35c-4008-b7cb-fca3647cd3dd service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.598438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ad07b245-3629-4776-8aca-adcb0c3ebbd7 req-687b41a5-b35c-4008-b7cb-fca3647cd3dd service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.599194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ad07b245-3629-4776-8aca-adcb0c3ebbd7 req-687b41a5-b35c-4008-b7cb-fca3647cd3dd service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.639131 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ad07b245-3629-4776-8aca-adcb0c3ebbd7 req-687b41a5-b35c-4008-b7cb-fca3647cd3dd service nova] Creating event network-vif-deleted:5bb807a1-782e-4eeb-9592-d5bfdff8af48 for instance 807f29b0-19d4-4261-a69d-4c78413bc735 on hv-cinder-maste Oct 02 01:01:30.653532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ad07b245-3629-4776-8aca-adcb0c3ebbd7 req-687b41a5-b35c-4008-b7cb-fca3647cd3dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085127 Oct 02 01:01:30.654168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 371/736] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:30.691746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:30.692273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:30.694238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:30.707680 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.708469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.709065 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.710516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.713680 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.714375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.802981 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:30.804540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:30.805454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:30.806847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lazy-loading 'fault' on Instance uuid 807f29b0-19d4-4261-a69d-4c78413bc735 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:01:30.877227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:30.892568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:30.897494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8894fd1044241ee8ba84927b6e8326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4aef28dfc444ee914b56c64b2edb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:30.899259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7f056bc7-370e-4674-a4c9-c390c15559b0 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 200 len: 1369 microversion: 2.20 time: 0.211425 Oct 02 01:01:30.900386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 366/737] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:30 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 02 01:01:31.453587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:31.455145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:31.464209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:31.464987 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:31.465587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:31.466537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:31.467209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:31.467826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:31.744679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:31.754337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18f21e78-3e3d-41b8-9552-58d276e8afe2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1367 microversion: 2.1 time: 0.310984 Oct 02 01:01:31.755687 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 372/738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:31 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:31.932058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:31.933132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:31.941821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:31.942639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:31.943275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:31.946600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:31.947431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:31.948025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:31.965929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] HTTP exception thrown: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Request method failure captured: Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 HTTP/1.1 Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFWBQtVcLbllOpkW-5S-ru1Z7fiXDi2FLDYkQuVZQIpJgEOI5XkdasbxdTjURWOTMGUFwobqbPA6gBjFtlceFOn7ttIFNhgp67rXywsEbKp3GtzoDJ4GsyVTHo9wJm5vNPpJVgcmRoAnu-zlnpCxRcJCPG3feLubEm_i8dgNeEUrAg Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:01:31.969490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}] Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: a8894fd1044241ee8ba84927b6e8326a Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:31.971242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '807f29b0-19d4-4261-a69d-4c78413bc735'} Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:31.972349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:31.973735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:31.978430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Returning 404 to user: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:31.979908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4b5b2598-bda1-4f50-9847-5d57d55031ec tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 404 len: 111 microversion: 2.20 time: 0.058009 Oct 02 01:01:31.981102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 367/739] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:31 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:01:31.989484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52717359-befc-461e-b831-57fa4b4b8f4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '.version_select at 0x7f6e78dec430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:32.014192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-52717359-befc-461e-b831-57fa4b4b8f4d tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552501722" status: 204 len: 0 microversion: 2.20 time: 0.027830 Oct 02 01:01:32.018988 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 373/740] 10.222.0.25 () {60 vars in 1259 bytes} [Sun Oct 2 01:01:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552501722 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 02 01:01:32.671562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-2df959ac-c349-470a-9524-0cd859a68415 req-cf9222f5-bd08-4bfe-90c2-6242538d1463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1", "tag": "a3f6bd30-fd03-41e0-ae97-4ad1d8dc82cd"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:32.681002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2df959ac-c349-470a-9524-0cd859a68415 req-cf9222f5-bd08-4bfe-90c2-6242538d1463 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.681561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2df959ac-c349-470a-9524-0cd859a68415 req-cf9222f5-bd08-4bfe-90c2-6242538d1463 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.682155 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-2df959ac-c349-470a-9524-0cd859a68415 req-cf9222f5-bd08-4bfe-90c2-6242538d1463 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.698584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-2df959ac-c349-470a-9524-0cd859a68415 req-cf9222f5-bd08-4bfe-90c2-6242538d1463 service nova] Creating event network-changed:a3f6bd30-fd03-41e0-ae97-4ad1d8dc82cd for instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 on hv-cinder-maste Oct 02 01:01:32.703786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-2df959ac-c349-470a-9524-0cd859a68415 req-cf9222f5-bd08-4bfe-90c2-6242538d1463 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036180 Oct 02 01:01:32.704381 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 368/741] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:32.780448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:32.781010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:32.791974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.792640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.793298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:32.798633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:32.798633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:32.798633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:33.060382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:33.069120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b271cd9-799b-4896-89e8-6728170590f9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1367 microversion: 2.1 time: 0.293346 Oct 02 01:01:33.069990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 374/742] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:32 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:34.097948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:34.098895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:34.105389 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.106156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.106694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.107517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.108062 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.108697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.247071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:34.254759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e339668d-c107-4613-ab61-a573bc415824 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1367 microversion: 2.1 time: 0.165794 Oct 02 01:01:34.255316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 369/743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:34 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:34.322309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:34.322830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:34.329375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.329859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.330333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.331031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.331487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.331917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.346368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] HTTP exception thrown: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Request method failure captured: Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 HTTP/1.1 Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFWBQtVcLbllOpkW-5S-ru1Z7fiXDi2FLDYkQuVZQIpJgEOI5XkdasbxdTjURWOTMGUFwobqbPA6gBjFtlceFOn7ttIFNhgp67rXywsEbKp3GtzoDJ4GsyVTHo9wJm5vNPpJVgcmRoAnu-zlnpCxRcJCPG3feLubEm_i8dgNeEUrAg Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:01:34.348096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}] Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: a8894fd1044241ee8ba84927b6e8326a Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.349697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '807f29b0-19d4-4261-a69d-4c78413bc735'} Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:34.351264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.352829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.354311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Returning 404 to user: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:34.354311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2bb6b2b7-4773-49e6-8fa8-4884556e92d5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 404 len: 111 microversion: 2.20 time: 0.031219 Oct 02 01:01:34.354311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 375/744] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Oct 2 01:01:34 2022] DELETE /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:01:34.359027 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:34.359906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 807f29b0-19d4-4261-a69d-4c78413bc735] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:34.366662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.367229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.367667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.368371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:34.368964 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:34.369386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:34.383104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] HTTP exception thrown: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Request method failure captured: Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 HTTP/1.1 Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFWBQtVcLbllOpkW-5S-ru1Z7fiXDi2FLDYkQuVZQIpJgEOI5XkdasbxdTjURWOTMGUFwobqbPA6gBjFtlceFOn7ttIFNhgp67rXywsEbKp3GtzoDJ4GsyVTHo9wJm5vNPpJVgcmRoAnu-zlnpCxRcJCPG3feLubEm_i8dgNeEUrAg Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:01:34.384785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}] Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: a8894fd1044241ee8ba84927b6e8326a Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.386393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '807f29b0-19d4-4261-a69d-4c78413bc735'} Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:34.387121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. Oct 02 01:01:34.388372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:34.389445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Returning 404 to user: Instance 807f29b0-19d4-4261-a69d-4c78413bc735 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:34.389445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a9975500-4df5-4b5d-b364-1511d5613238 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735" status: 404 len: 111 microversion: 2.20 time: 0.031361 Oct 02 01:01:34.389445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 370/745] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:34 2022] GET /compute/v2.1/servers/807f29b0-19d4-4261-a69d-4c78413bc735 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:01:35.281127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:35.281747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:35.287881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.288365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.288799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.289523 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.290157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.290578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.376878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:35.404397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:35.464873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:35.478407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1dcb6b0e-52ca-4886-a01e-624fa4e13ead tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1367 microversion: 2.1 time: 0.195910 Oct 02 01:01:35.481628 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 376/746] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:35 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:35.515516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-ed60778f-2b91-4f1d-8aa5-92422a4ba6cc req-87674888-c4f8-4164-afc9-65374e91558a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1", "name": "network-vif-plugged", "status": "completed", "tag": "a3f6bd30-fd03-41e0-ae97-4ad1d8dc82cd"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:35.526578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-ed60778f-2b91-4f1d-8aa5-92422a4ba6cc req-87674888-c4f8-4164-afc9-65374e91558a service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.527336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-ed60778f-2b91-4f1d-8aa5-92422a4ba6cc req-87674888-c4f8-4164-afc9-65374e91558a service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.529422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-ed60778f-2b91-4f1d-8aa5-92422a4ba6cc req-87674888-c4f8-4164-afc9-65374e91558a service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.543653 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:35.544371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:35.550627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-ed60778f-2b91-4f1d-8aa5-92422a4ba6cc req-87674888-c4f8-4164-afc9-65374e91558a service nova] Creating event network-vif-plugged:a3f6bd30-fd03-41e0-ae97-4ad1d8dc82cd for instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 on hv-cinder-maste Oct 02 01:01:35.551280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.551960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.552568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.553946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.554595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.555028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.556553 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-ed60778f-2b91-4f1d-8aa5-92422a4ba6cc req-87674888-c4f8-4164-afc9-65374e91558a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046530 Oct 02 01:01:35.557678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 371/747] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:35.570374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] HTTP exception thrown: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Request method failure captured: Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 HTTP/1.1 Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOFWBQtVcLbllOpkW-5S-ru1Z7fiXDi2FLDYkQuVZQIpJgEOI5XkdasbxdTjURWOTMGUFwobqbPA6gBjFtlceFOn7ttIFNhgp67rXywsEbKp3GtzoDJ4GsyVTHo9wJm5vNPpJVgcmRoAnu-zlnpCxRcJCPG3feLubEm_i8dgNeEUrAg Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:01:35.572452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}] Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: a8894fd1044241ee8ba84927b6e8326a Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.573928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '6c4241ee-1589-42f2-986e-abe5f0a2c369'} Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:35.574714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.576000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.579461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Returning 404 to user: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:35.580526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b0fd4b00-4b97-45cf-8da2-716b6549e5d4 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 404 len: 111 microversion: 2.20 time: 0.041411 Oct 02 01:01:35.581104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 377/748] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Oct 2 01:01:35 2022] DELETE /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:01:35.590179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:35.590937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] [instance: 6c4241ee-1589-42f2-986e-abe5f0a2c369] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:35.594796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:35.599224 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.600940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.601593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.602413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:35.602929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:35.606804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:35.631257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] HTTP exception thrown: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Request method failure captured: Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 HTTP/1.1 Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOFWBQtVcLbllOpkW-5S-ru1Z7fiXDi2FLDYkQuVZQIpJgEOI5XkdasbxdTjURWOTMGUFwobqbPA6gBjFtlceFOn7ttIFNhgp67rXywsEbKp3GtzoDJ4GsyVTHo9wJm5vNPpJVgcmRoAnu-zlnpCxRcJCPG3feLubEm_i8dgNeEUrAg Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Openstack-Nova-Api-Version: 2.20 Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:01:35.633494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4aef28dfc444ee914b56c64b2edb77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4aef28dfc444ee914b56c64b2edb77"}]}] Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: ff4aef28dfc444ee914b56c64b2edb77 Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-670548249 Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: a8894fd1044241ee8ba84927b6e8326a Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeShelveTestJSON-670548249-project Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.635047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '6c4241ee-1589-42f2-986e-abe5f0a2c369'} Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:01:35.635771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. Oct 02 01:01:35.639968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:01:35.641562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] Returning 404 to user: Instance 6c4241ee-1589-42f2-986e-abe5f0a2c369 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:01:35.641562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0ac64ab3-fc08-416d-b1fb-59b21bd132a5 tempest-AttachVolumeShelveTestJSON-670548249 tempest-AttachVolumeShelveTestJSON-670548249-project] 10.222.0.25 "GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369" status: 404 len: 111 microversion: 2.20 time: 0.049125 Oct 02 01:01:35.641562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 372/749] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Oct 2 01:01:35 2022] GET /compute/v2.1/servers/6c4241ee-1589-42f2-986e-abe5f0a2c369 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:01:36.504484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:36.505089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:36.512948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.517276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.517863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:36.518953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:36.519487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:36.520242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:36.773734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:36.808435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bcf839df-92ff-40d4-ba15-3ecac04a347a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1367 microversion: 2.1 time: 0.307631 Oct 02 01:01:36.809101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 378/750] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:36 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:37.831999 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:37.832766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:37.840181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:37.841133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:37.841851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:37.842780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:37.843430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:37.844162 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.151783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:38.161116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6843fe9c-baa2-4f4a-9236-86371c980533 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1557 microversion: 2.1 time: 0.333262 Oct 02 01:01:38.167119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 373/751] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:37 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1557 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:38.192534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a72e8bef-bdee-47e9-a9fb-c2f1d809bd3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:38.195530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a72e8bef-bdee-47e9-a9fb-c2f1d809bd3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:38.207952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72e8bef-bdee-47e9-a9fb-c2f1d809bd3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:38.208585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72e8bef-bdee-47e9-a9fb-c2f1d809bd3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:38.209082 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72e8bef-bdee-47e9-a9fb-c2f1d809bd3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.214608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72e8bef-bdee-47e9-a9fb-c2f1d809bd3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:38.215404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72e8bef-bdee-47e9-a9fb-c2f1d809bd3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:38.216029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72e8bef-bdee-47e9-a9fb-c2f1d809bd3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:38.326861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a72e8bef-bdee-47e9-a9fb-c2f1d809bd3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140360 Oct 02 01:01:38.327638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 379/752] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Oct 2 01:01:38 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:39.500096 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-0228771c-bbb2-4bb9-837a-c971a8d7ac3c req-4f3f2d67-18af-4c8b-a165-8889a818c7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1", "tag": "a3f6bd30-fd03-41e0-ae97-4ad1d8dc82cd"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:39.530767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-0228771c-bbb2-4bb9-837a-c971a8d7ac3c req-4f3f2d67-18af-4c8b-a165-8889a818c7f8 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:39.534098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-0228771c-bbb2-4bb9-837a-c971a8d7ac3c req-4f3f2d67-18af-4c8b-a165-8889a818c7f8 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:39.534595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-0228771c-bbb2-4bb9-837a-c971a8d7ac3c req-4f3f2d67-18af-4c8b-a165-8889a818c7f8 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:39.564354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-0228771c-bbb2-4bb9-837a-c971a8d7ac3c req-4f3f2d67-18af-4c8b-a165-8889a818c7f8 service nova] Creating event network-changed:a3f6bd30-fd03-41e0-ae97-4ad1d8dc82cd for instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 on hv-cinder-maste Oct 02 01:01:39.569885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-0228771c-bbb2-4bb9-837a-c971a8d7ac3c req-4f3f2d67-18af-4c8b-a165-8889a818c7f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074996 Oct 02 01:01:39.571018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 374/753] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:01:53.996829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:53.997570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=56 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:54.002300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1116911167", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "networks": [{"uuid": "41f075aa-cca4-432a-a4c0-a4c179437839"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:54.057602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] validate_networks() for [('41f075aa-cca4-432a-a4c0-a4c179437839', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:01:54.401807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:01:54.402275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:01:54.402753 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:01:54.403156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:01:54.403572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:01:54.413058 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.413545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.413984 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.414753 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:54.415210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:54.415693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:54.432767 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Getting quotas for project 31b72d052142491dbfc1936f4f006715. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:01:54.436716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Getting quotas for user a84c6036067e4ed2817f56d95eaf1715 and project 31b72d052142491dbfc1936f4f006715. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:01:54.447918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:01:54.450201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:01:54.495593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c040d8e-ce0c-4cce-8c21-61f403a17621 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500081 Oct 02 01:01:54.496226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 380/754] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:01:54.505371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=19 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:54.506397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=34 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:01:54.510376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8e7cbfd3-8b91-4dd2-93d4-398650c21867 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:54.512510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8e7cbfd3-8b91-4dd2-93d4-398650c21867 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:54.566486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8e7cbfd3-8b91-4dd2-93d4-398650c21867 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:54.574881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8e7cbfd3-8b91-4dd2-93d4-398650c21867 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1219 microversion: 2.1 time: 0.071334 Oct 02 01:01:54.575581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 375/755] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:54 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:55.598023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:55.598760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:55.606031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.606533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.606970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.607651 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:55.608100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:55.608580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:55.681846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:55.689643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c32f3962-eba7-4587-9367-9d1b1f10ae24 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1279 microversion: 2.1 time: 0.096074 Oct 02 01:01:55.690440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 381/756] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:55 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:56.715006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:56.715670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:56.723188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.723679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.724126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.725338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:56.725796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:56.726262 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:56.957203 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:56.965622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b0c2c3c8-b931-4adf-a448-248504c838cb tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1319 microversion: 2.1 time: 0.254984 Oct 02 01:01:56.966215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 376/757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:56 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:57.340183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f62f66c7-2dd6-4535-a3bd-e7eb7c464df3 req-8c48e489-9f24-499f-88a0-6188f9511675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03036bb1-81e9-41fa-ade9-140c27ad953f", "tag": "bead8b63-8ad4-4dd9-9638-f6718667777a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:01:57.352352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f62f66c7-2dd6-4535-a3bd-e7eb7c464df3 req-8c48e489-9f24-499f-88a0-6188f9511675 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:57.353297 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f62f66c7-2dd6-4535-a3bd-e7eb7c464df3 req-8c48e489-9f24-499f-88a0-6188f9511675 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:57.353795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f62f66c7-2dd6-4535-a3bd-e7eb7c464df3 req-8c48e489-9f24-499f-88a0-6188f9511675 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:57.365434 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f62f66c7-2dd6-4535-a3bd-e7eb7c464df3 req-8c48e489-9f24-499f-88a0-6188f9511675 service nova] Creating event network-changed:bead8b63-8ad4-4dd9-9638-f6718667777a for instance 03036bb1-81e9-41fa-ade9-140c27ad953f on hv-cinder-maste Oct 02 01:01:57.371007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f62f66c7-2dd6-4535-a3bd-e7eb7c464df3 req-8c48e489-9f24-499f-88a0-6188f9511675 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035693 Oct 02 01:01:57.371587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 382/758] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:01:57.988713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:57.989650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:57.996666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:57.997142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:57.997579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:57.998293 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:57.998748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:57.999173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:58.128968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:58.136652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-144727cb-ff26-464d-8a18-512baff9dc1e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1319 microversion: 2.1 time: 0.151762 Oct 02 01:01:58.137213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 377/759] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:57 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:01:59.160079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:01:59.160703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:01:59.167239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.167718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.168159 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.168846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:01:59.169301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:01:59.169728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:01:59.301047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:01:59.308903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be72dc22-51bd-4969-b08e-2b80cc148b7a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1319 microversion: 2.1 time: 0.152785 Oct 02 01:01:59.309496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 383/760] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:01:59 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:00.331401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:00.332016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:00.338959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:00.339444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:00.339881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:00.340578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:00.341156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:00.341625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:00.477318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:00.485709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3fca2186-4fd7-42ae-bdba-954c0fd4b174 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1319 microversion: 2.1 time: 0.158462 Oct 02 01:02:00.498049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 378/761] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:00 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:01.508941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:01.510139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:01.517025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:01.517695 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:01.518381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.519264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:01.519903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:01.520527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.592148 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-c075685d-383e-4ef6-a489-6486fbd7c1ea req-601ff947-17ea-4710-9800-56619716627a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03036bb1-81e9-41fa-ade9-140c27ad953f", "name": "network-vif-plugged", "status": "completed", "tag": "bead8b63-8ad4-4dd9-9638-f6718667777a"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:01.604600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-c075685d-383e-4ef6-a489-6486fbd7c1ea req-601ff947-17ea-4710-9800-56619716627a service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:01.605325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-c075685d-383e-4ef6-a489-6486fbd7c1ea req-601ff947-17ea-4710-9800-56619716627a service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:01.605882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-c075685d-383e-4ef6-a489-6486fbd7c1ea req-601ff947-17ea-4710-9800-56619716627a service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:01.618680 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-c075685d-383e-4ef6-a489-6486fbd7c1ea req-601ff947-17ea-4710-9800-56619716627a service nova] Creating event network-vif-plugged:bead8b63-8ad4-4dd9-9638-f6718667777a for instance 03036bb1-81e9-41fa-ade9-140c27ad953f on hv-cinder-maste Oct 02 01:02:01.624026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-c075685d-383e-4ef6-a489-6486fbd7c1ea req-601ff947-17ea-4710-9800-56619716627a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036401 Oct 02 01:02:01.624380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 379/762] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:02:01.673386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:01.685488 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-520ad10d-8ecb-4fad-9df3-9ba4403fa758 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1319 microversion: 2.1 time: 0.180240 Oct 02 01:02:01.686084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 384/763] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:01 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:02.710226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:02.710911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:02.721453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:02.721936 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:02.722401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:02.723097 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:02.723546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:02.723969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:02.866880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:02.874970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6734ebf8-a93e-4ec9-ac58-83f849936dbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1319 microversion: 2.1 time: 0.170190 Oct 02 01:02:02.875575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 380/764] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:02 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:03.898754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:03.899390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:03.905845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:03.906347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:03.906779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:03.907465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:03.907913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:03.908329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:04.054833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:04.062536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a0683da7-040f-42f4-8792-a7c02ccae53f tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1509 microversion: 2.1 time: 0.167977 Oct 02 01:02:04.063096 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 385/765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:03 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:16.121535 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a2132568-0a1c-4cc2-9686-0761372c31f1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:16.122111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a2132568-0a1c-4cc2-9686-0761372c31f1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:16.124462 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:16.125160 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=14 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:16.125770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=26 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:16.132960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2132568-0a1c-4cc2-9686-0761372c31f1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:16.133438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2132568-0a1c-4cc2-9686-0761372c31f1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:16.133873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2132568-0a1c-4cc2-9686-0761372c31f1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:16.134585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2132568-0a1c-4cc2-9686-0761372c31f1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:16.135036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2132568-0a1c-4cc2-9686-0761372c31f1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:16.135460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2132568-0a1c-4cc2-9686-0761372c31f1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:16.160595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a2132568-0a1c-4cc2-9686-0761372c31f1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/ips" status: 200 len: 150 microversion: 2.1 time: 0.042823 Oct 02 01:02:16.161210 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 381/766] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 01:02:16 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:17.520645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6cfd97c8-e4cb-47f9-bb9b-31d1a142aa98 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:17.523076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6cfd97c8-e4cb-47f9-bb9b-31d1a142aa98 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:17.525040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:17.525696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:17.526476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:17.527252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=28 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:17.533928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfd97c8-e4cb-47f9-bb9b-31d1a142aa98 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:17.534439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfd97c8-e4cb-47f9-bb9b-31d1a142aa98 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:17.534877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfd97c8-e4cb-47f9-bb9b-31d1a142aa98 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:17.535564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfd97c8-e4cb-47f9-bb9b-31d1a142aa98 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:17.536514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfd97c8-e4cb-47f9-bb9b-31d1a142aa98 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:17.536936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfd97c8-e4cb-47f9-bb9b-31d1a142aa98 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:17.816686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6cfd97c8-e4cb-47f9-bb9b-31d1a142aa98 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300009 Oct 02 01:02:17.817316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 386/767] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:02:17 2022] POST /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:26.408090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4375fbca-c0c0-4e88-a8ac-c0d3d6045a21 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: .version_select at 0x7f6e78eb8160>, body: {"keypair": {"name": "tempest-keypair-374502255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyOEEI9q8zbYtpHYU3YpL6AlhxAl0Tw/uY1db+npu6nwjcUyyDjgWku7BJL9rI+NozjUYxLafIL3PeG4kjtJX94EsDReZ2LhtwSHR/vBopCRB+a+EO/pM7LAjEAM9fxfQ=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:26.413683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:26.414342 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=4 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:26.426522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-4375fbca-c0c0-4e88-a8ac-c0d3d6045a21 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for project 29870f31b41846cc923a28ebfaf368db. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:26.430395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-4375fbca-c0c0-4e88-a8ac-c0d3d6045a21 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for user 1750f2cc69c0499ebade616da183507b and project 29870f31b41846cc923a28ebfaf368db. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:26.451954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4375fbca-c0c0-4e88-a8ac-c0d3d6045a21 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047617 Oct 02 01:02:26.452539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 382/768] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 01:02:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:27.679430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:27.685234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2126071431", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "187441bc-85a8-46c2-a472-a2fcaf6bcd79"}], "security_groups": [{"name": "tempest-securitygroup--1932998114"}], "key_name": "tempest-keypair-374502255", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:27.788827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] validate_networks() for [('187441bc-85a8-46c2-a472-a2fcaf6bcd79', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:02:27.809080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:28.150160 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:02:28.151145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:02:28.151692 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:02:28.152147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:02:28.152561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:02:28.161381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.161876 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.162376 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:28.163184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.163700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.164146 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:28.181165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for project 29870f31b41846cc923a28ebfaf368db. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:28.185494 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for user 1750f2cc69c0499ebade616da183507b and project 29870f31b41846cc923a28ebfaf368db. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:28.196593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:02:28.199710 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:02:28.247597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d971500-d9f0-4d20-b539-1e563aad57ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.569685 Oct 02 01:02:28.248237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 387/769] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:02:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:02:28.260402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9afbad8a-c6c3-4959-814c-98d16c0587b9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:28.261026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9afbad8a-c6c3-4959-814c-98d16c0587b9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:28.320609 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9afbad8a-c6c3-4959-814c-98d16c0587b9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:28.328122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9afbad8a-c6c3-4959-814c-98d16c0587b9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1241 microversion: 2.1 time: 0.072598 Oct 02 01:02:28.328691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 383/770] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:28 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:28.787219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd1771c2-307e-43c9-8b1d-02267b459d3a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4673e73c-baf7-4426-b812-33b7c2d655f1", "device": "/dev/sdb"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:28.790353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd1771c2-307e-43c9-8b1d-02267b459d3a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:28.796842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1771c2-307e-43c9-8b1d-02267b459d3a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.797323 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1771c2-307e-43c9-8b1d-02267b459d3a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.797758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1771c2-307e-43c9-8b1d-02267b459d3a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:28.798499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1771c2-307e-43c9-8b1d-02267b459d3a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:28.798952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1771c2-307e-43c9-8b1d-02267b459d3a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:28.799491 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1771c2-307e-43c9-8b1d-02267b459d3a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:29.068743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd1771c2-307e-43c9-8b1d-02267b459d3a tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "POST /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286070 Oct 02 01:02:29.069355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 388/771] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:02:28 2022] POST /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:29.351037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:29.351565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:29.358473 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:29.358955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:29.359388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:29.360072 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:29.360519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:29.360941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:29.424441 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:29.433218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d97adf5f-bc7d-4d68-b918-8dab673ece7b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1293 microversion: 2.1 time: 0.085908 Oct 02 01:02:29.433948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 384/772] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:29 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:30.457781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:30.458624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:30.465354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.465921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.466457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.467275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:30.467839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:30.468333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:30.682937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:30.690968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-902f489b-e059-4704-ac84-28733779d46d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1367 microversion: 2.1 time: 0.238086 Oct 02 01:02:30.691542 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 389/773] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:30 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:30.994236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-faf9c494-63bc-4679-90cc-60206cab19dd req-4aac5391-221c-4b00-b80a-ac2c08fa6b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21532c9-c67d-40e7-a8c2-56989e7f2498", "tag": "4a9965b5-643d-4478-8378-7760d8362e4f"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:31.004974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-faf9c494-63bc-4679-90cc-60206cab19dd req-4aac5391-221c-4b00-b80a-ac2c08fa6b81 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.005874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-faf9c494-63bc-4679-90cc-60206cab19dd req-4aac5391-221c-4b00-b80a-ac2c08fa6b81 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.006366 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-faf9c494-63bc-4679-90cc-60206cab19dd req-4aac5391-221c-4b00-b80a-ac2c08fa6b81 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.019891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-faf9c494-63bc-4679-90cc-60206cab19dd req-4aac5391-221c-4b00-b80a-ac2c08fa6b81 service nova] Creating event network-changed:4a9965b5-643d-4478-8378-7760d8362e4f for instance b21532c9-c67d-40e7-a8c2-56989e7f2498 on hv-cinder-maste Oct 02 01:02:31.024908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-faf9c494-63bc-4679-90cc-60206cab19dd req-4aac5391-221c-4b00-b80a-ac2c08fa6b81 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035144 Oct 02 01:02:31.026188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 385/774] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:31.714194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:31.714720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:31.721018 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.721490 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.721916 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.722623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:31.723069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:31.723484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:31.847937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:31.856024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d02014ce-c976-42be-b473-c7b12bca7f9b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1367 microversion: 2.1 time: 0.146280 Oct 02 01:02:31.856585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 390/775] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:31 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:32.880023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:32.880719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:32.887258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.887748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.888177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:32.888871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:32.889316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:32.889734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:33.021607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:33.029967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2d806b13-a86f-4486-aa79-4dd8fd1d2ea6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1367 microversion: 2.1 time: 0.154219 Oct 02 01:02:33.035139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 386/776] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:32 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:34.052705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:34.053310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:34.060511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.060985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.061415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.062113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:34.062565 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:34.062983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:34.190328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:34.197922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d3f8d7c-aa34-4ac9-a900-7b7ce46a2869 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1367 microversion: 2.1 time: 0.149088 Oct 02 01:02:34.198515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 391/777] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:34 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:35.220373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:35.220918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:35.227307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.227788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.228734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.229424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:35.229871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:35.230326 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:35.388606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:35.396321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d1d8430a-be6a-415e-a6a3-7808297a9aa2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1367 microversion: 2.1 time: 0.179947 Oct 02 01:02:35.396883 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 387/778] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:35 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:36.122566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0017aab1-bc13-489a-89c8-f6b303cede0f req-57e2333e-b877-49a8-b84f-6c0133fbfb22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21532c9-c67d-40e7-a8c2-56989e7f2498", "name": "network-vif-plugged", "status": "completed", "tag": "4a9965b5-643d-4478-8378-7760d8362e4f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:36.135535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0017aab1-bc13-489a-89c8-f6b303cede0f req-57e2333e-b877-49a8-b84f-6c0133fbfb22 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:36.136420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0017aab1-bc13-489a-89c8-f6b303cede0f req-57e2333e-b877-49a8-b84f-6c0133fbfb22 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:36.137051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0017aab1-bc13-489a-89c8-f6b303cede0f req-57e2333e-b877-49a8-b84f-6c0133fbfb22 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:36.150700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0017aab1-bc13-489a-89c8-f6b303cede0f req-57e2333e-b877-49a8-b84f-6c0133fbfb22 service nova] Creating event network-vif-plugged:4a9965b5-643d-4478-8378-7760d8362e4f for instance b21532c9-c67d-40e7-a8c2-56989e7f2498 on hv-cinder-maste Oct 02 01:02:36.155951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0017aab1-bc13-489a-89c8-f6b303cede0f req-57e2333e-b877-49a8-b84f-6c0133fbfb22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037419 Oct 02 01:02:36.156540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 392/779] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:36.418991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:36.419612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:36.425857 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:36.426438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:36.426881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:36.427580 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:36.428036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:36.428465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:36.552927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:36.560796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-30e36a5e-c09e-447d-9aa8-0e39f511d5e3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1367 microversion: 2.1 time: 0.145595 Oct 02 01:02:36.561356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 388/780] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:36 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:37.584416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:37.585111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:37.592334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:37.592882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:37.593387 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:37.594372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:37.594865 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:37.595289 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:37.722040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:37.729795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b73650e-01fe-4199-913f-a4b71c275208 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1367 microversion: 2.1 time: 0.150223 Oct 02 01:02:37.730377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 393/781] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:37 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:38.753314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:38.753931 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:38.756329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:38.761842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.762417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.762850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.763534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:38.763983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:38.764410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:38.892115 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:38.899693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-60dd4702-3ab9-49b8-9563-4f62b0822f88 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1367 microversion: 2.1 time: 0.150231 Oct 02 01:02:38.900248 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 389/782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:38 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:39.922464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:39.923120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:39.925306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:39.925974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:39.932655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.933121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.933559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:39.934285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:39.934740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:39.935170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:40.342497 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:40.350374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22570df5-dfee-4189-8b8b-d392e569d419 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1367 microversion: 2.1 time: 0.431978 Oct 02 01:02:40.350941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 394/783] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:39 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:41.373564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:41.374230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:41.384356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.384356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.384356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.384356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.384726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.384726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.512671 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:41.520375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a659b498-9362-417e-97ae-c9c53174c690 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1557 microversion: 2.1 time: 0.151338 Oct 02 01:02:41.520934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 390/784] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:41 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:41.541740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c15058e6-05e0-4add-b7d7-bf2b09427f06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:41.542252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c15058e6-05e0-4add-b7d7-bf2b09427f06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:41.548535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15058e6-05e0-4add-b7d7-bf2b09427f06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.549012 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15058e6-05e0-4add-b7d7-bf2b09427f06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.549439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15058e6-05e0-4add-b7d7-bf2b09427f06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.550149 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15058e6-05e0-4add-b7d7-bf2b09427f06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:41.550601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15058e6-05e0-4add-b7d7-bf2b09427f06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:41.551024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15058e6-05e0-4add-b7d7-bf2b09427f06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:41.773565 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c15058e6-05e0-4add-b7d7-bf2b09427f06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.235516 Oct 02 01:02:41.774182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 395/785] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Oct 2 01:02:41 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498/os-interface => generated 284 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:42.669422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-074dbdc8-d3be-4c09-a6a5-790d4283f213 req-4d64f619-e5a8-4dac-a432-573d50bd7779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21532c9-c67d-40e7-a8c2-56989e7f2498", "tag": "4a9965b5-643d-4478-8378-7760d8362e4f"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:42.679587 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-074dbdc8-d3be-4c09-a6a5-790d4283f213 req-4d64f619-e5a8-4dac-a432-573d50bd7779 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:42.680176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-074dbdc8-d3be-4c09-a6a5-790d4283f213 req-4d64f619-e5a8-4dac-a432-573d50bd7779 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:42.680656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-074dbdc8-d3be-4c09-a6a5-790d4283f213 req-4d64f619-e5a8-4dac-a432-573d50bd7779 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:42.692822 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-074dbdc8-d3be-4c09-a6a5-790d4283f213 req-4d64f619-e5a8-4dac-a432-573d50bd7779 service nova] Creating event network-changed:4a9965b5-643d-4478-8378-7760d8362e4f for instance b21532c9-c67d-40e7-a8c2-56989e7f2498 on hv-cinder-maste Oct 02 01:02:42.697914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-074dbdc8-d3be-4c09-a6a5-790d4283f213 req-4d64f619-e5a8-4dac-a432-573d50bd7779 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032847 Oct 02 01:02:42.698741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 391/786] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:52.951218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:52.951962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:52.956112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:52.956639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:52.970919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.971726 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.972382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:52.973564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:52.975201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:52.977284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:53.125329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lazy-loading 'services' on Instance uuid 03036bb1-81e9-41fa-ade9-140c27ad953f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:02:53.222010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e94bb6fd-fd7c-408e-8f51-59bac37102aa tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f/os-volume_attachments/4673e73c-baf7-4426-b812-33b7c2d655f1" status: 202 len: 0 microversion: 2.1 time: 0.272013 Oct 02 01:02:53.223091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 396/787] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 01:02:52 2022] DELETE /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f/os-volume_attachments/4673e73c-baf7-4426-b812-33b7c2d655f1 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:02:54.423959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.425192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:54.429162 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:54.430117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=40 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:02:54.441234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.441935 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.442644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.443378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.443994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.444773 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.476208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:02:54.567661 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-47bd3e49-530e-4ab7-b0bf-f6604cd3aa3c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 204 len: 0 microversion: 2.1 time: 0.148010 Oct 02 01:02:54.570914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 392/788] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:02:54 2022] DELETE /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:02:54.580324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:54.581034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:54.587678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.588203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.588640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.589346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:54.589794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:54.590245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:54.789064 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:54.797446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26d4bdba-72a8-491c-af6f-287353283d93 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1515 microversion: 2.1 time: 0.221903 Oct 02 01:02:54.799021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 397/789] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:54 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:02:55.676365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9bc77d41-0ed6-42ec-92eb-4967c3ca42da tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Action: 'create', calling method: .version_select at 0x7f6e78df65e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1356466823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoAt/ZeR6jbg3+at4WXIkVDaHYBu99Ucc6VJ8F3fV7Z9yt1aSoxtJyKngqKurXQVD/yiWzzHecuWGmQnxTiP7dob1vQ6z+0rSEvx5FtaUdj8vETABFO/pHgQMLkAAXqIQ=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:55.692413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-9bc77d41-0ed6-42ec-92eb-4967c3ca42da tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Getting quotas for project 017c596a2d0f430d987352a616666610. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:02:55.696322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-9bc77d41-0ed6-42ec-92eb-4967c3ca42da tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Getting quotas for user a94a5f91289c403cb49f428e53431591 and project 017c596a2d0f430d987352a616666610. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:02:55.718413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9bc77d41-0ed6-42ec-92eb-4967c3ca42da tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.250097 Oct 02 01:02:55.719010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 393/790] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 01:02:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:55.826575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:55.827192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:55.833176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.833656 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.834108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.834798 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:55.835242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:55.835658 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:55.968934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:55.979159 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d160be60-9477-4f83-b694-2175c9aa9f50 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1515 microversion: 2.1 time: 0.156886 Oct 02 01:02:55.979581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 398/791] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:55 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:57.004994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:57.005841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:57.019968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.029048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.031286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.032073 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.032560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.033005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.074454 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0b645c18-53cc-40d0-a52a-a7a8f378e408 req-0236a6f6-d138-4f4f-849e-d323befd26b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03036bb1-81e9-41fa-ade9-140c27ad953f", "name": "network-vif-deleted", "tag": "bead8b63-8ad4-4dd9-9638-f6718667777a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:02:57.122079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0b645c18-53cc-40d0-a52a-a7a8f378e408 req-0236a6f6-d138-4f4f-849e-d323befd26b7 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:57.122601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0b645c18-53cc-40d0-a52a-a7a8f378e408 req-0236a6f6-d138-4f4f-849e-d323befd26b7 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:57.123038 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0b645c18-53cc-40d0-a52a-a7a8f378e408 req-0236a6f6-d138-4f4f-849e-d323befd26b7 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:57.135262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0b645c18-53cc-40d0-a52a-a7a8f378e408 req-0236a6f6-d138-4f4f-849e-d323befd26b7 service nova] Creating event network-vif-deleted:bead8b63-8ad4-4dd9-9638-f6718667777a for instance 03036bb1-81e9-41fa-ade9-140c27ad953f on hv-cinder-maste Oct 02 01:02:57.142765 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0b645c18-53cc-40d0-a52a-a7a8f378e408 req-0236a6f6-d138-4f4f-849e-d323befd26b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073827 Oct 02 01:02:57.144013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 399/792] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:02:57.167312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:02:57.176126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dec26933-2951-4f41-9675-cdcdbb32b009 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 200 len: 1473 microversion: 2.1 time: 0.176823 Oct 02 01:02:57.176716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 394/793] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:56 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:02:58.201971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:02:58.202834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: 03036bb1-81e9-41fa-ade9-140c27ad953f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:02:58.209206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.209728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.210135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:58.210867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:02:58.211299 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:02:58.211717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:02:58.225748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] HTTP exception thrown: Instance 03036bb1-81e9-41fa-ade9-140c27ad953f could not be found. Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Request method failure captured: Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f HTTP/1.1 Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOMAqx4Qc30uFUbxsKS5MhNBrTEdCGHFuoE82VTJUeFCjW37_WLSTQffsTDloT7-y6ejxWz73lqLbA05z7UkoMBYGCInRwtoLbUVIJN2bJyKfkDpMrWOeCUMF24Xz_UMZ-8dap5PtVb-2CQIp2c5eZBSJJ0T9S9y2lXNIGNkaH-asNE Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 31b72d052142491dbfc1936f4f006715 Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2044369547 Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:02:58.227368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31b72d052142491dbfc1936f4f006715"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31b72d052142491dbfc1936f4f006715"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31b72d052142491dbfc1936f4f006715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31b72d052142491dbfc1936f4f006715"}]}] Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotTestJSON-2044369547 Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 31b72d052142491dbfc1936f4f006715 Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2044369547 Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotTestJSON-2044369547-project Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: a84c6036067e4ed2817f56d95eaf1715 Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotTestJSON-2044369547-project Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 03036bb1-81e9-41fa-ade9-140c27ad953f could not be found. Oct 02 01:02:58.229088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '03036bb1-81e9-41fa-ade9-140c27ad953f'} Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03036bb1-81e9-41fa-ade9-140c27ad953f could not be found. Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:02:58.230044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03036bb1-81e9-41fa-ade9-140c27ad953f could not be found. Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03036bb1-81e9-41fa-ade9-140c27ad953f could not be found. Oct 02 01:02:58.231627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:02:58.233591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Returning 404 to user: Instance 03036bb1-81e9-41fa-ade9-140c27ad953f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:02:58.233591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4d634ac-4ec8-4564-8cfe-2a5f277a5104 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f" status: 404 len: 111 microversion: 2.1 time: 0.032178 Oct 02 01:02:58.233591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 400/794] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:02:58 2022] GET /compute/v2.1/servers/03036bb1-81e9-41fa-ade9-140c27ad953f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:08.137343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-811434421", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "networks": [{"uuid": "41f075aa-cca4-432a-a4c0-a4c179437839"}]}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:08.146113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=4 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:08.146707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:08.147347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:08.148377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:03:08.148498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:03:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 02 01:03:08.197521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] validate_networks() for [('41f075aa-cca4-432a-a4c0-a4c179437839', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:03:08.537972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:08.538423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:08.538895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:08.539300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:08.539707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:08.548962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.549437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.549862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.550614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:08.551063 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:08.551482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:08.567702 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Getting quotas for project 31b72d052142491dbfc1936f4f006715. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:08.571705 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Getting quotas for user a84c6036067e4ed2817f56d95eaf1715 and project 31b72d052142491dbfc1936f4f006715. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:08.582902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:03:08.585157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:03:08.630917 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-23cdb66e-a827-44f7-9fd7-c1ea131f4f23 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497486 Oct 02 01:03:08.631568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 395/795] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:03:08.643081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e1a002a-4a78-4dc6-bcca-5dfc16533cdc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:08.643697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e1a002a-4a78-4dc6-bcca-5dfc16533cdc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:08.645972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:08.647793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:08.701827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e1a002a-4a78-4dc6-bcca-5dfc16533cdc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:08.708694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e1a002a-4a78-4dc6-bcca-5dfc16533cdc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1218 microversion: 2.1 time: 0.069556 Oct 02 01:03:08.709439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 401/796] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:08 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:09.732531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:09.733081 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:09.739994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:09.740481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:09.740919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:09.741607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:09.742081 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:09.742510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:09.811146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:09.819648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-18c426a3-bbc0-4f2d-8cf0-ff2d65bd50ef tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1270 microversion: 2.1 time: 0.091685 Oct 02 01:03:09.820222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 396/797] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:09 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:10.843854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:10.844535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:10.852024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.852573 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.853019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:10.853772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:10.854200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:10.854795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:11.058883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:11.066730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02f9480d-3072-4b5a-bf3f-6b73b3ae9fbd tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1318 microversion: 2.1 time: 0.226956 Oct 02 01:03:11.067417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 402/798] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:10 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:11.323498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-b4e2d6fc-d2c2-4b79-918b-7b5b072ac205 req-056bae5e-2e5f-4df4-9195-63ea9e5f9019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c8cdad-5bc0-4363-8cb6-57858ca90ec8", "tag": "573fe390-6f7d-4e24-927b-0186ee9e131e"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:11.333652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b4e2d6fc-d2c2-4b79-918b-7b5b072ac205 req-056bae5e-2e5f-4df4-9195-63ea9e5f9019 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:11.334191 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b4e2d6fc-d2c2-4b79-918b-7b5b072ac205 req-056bae5e-2e5f-4df4-9195-63ea9e5f9019 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:11.334703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-b4e2d6fc-d2c2-4b79-918b-7b5b072ac205 req-056bae5e-2e5f-4df4-9195-63ea9e5f9019 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:11.346013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-b4e2d6fc-d2c2-4b79-918b-7b5b072ac205 req-056bae5e-2e5f-4df4-9195-63ea9e5f9019 service nova] Creating event network-changed:573fe390-6f7d-4e24-927b-0186ee9e131e for instance b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 on hv-cinder-maste Oct 02 01:03:11.350964 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-b4e2d6fc-d2c2-4b79-918b-7b5b072ac205 req-056bae5e-2e5f-4df4-9195-63ea9e5f9019 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032020 Oct 02 01:03:11.351555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 397/799] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:12.091335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:12.092025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:12.098498 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:12.098979 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:12.099414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:12.100215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:12.100672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:12.101126 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:12.235467 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:12.243422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a62a4f2-9803-4260-8ae5-f2d48131671d tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1318 microversion: 2.1 time: 0.156704 Oct 02 01:03:12.244002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 403/800] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:12 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:13.266675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:13.267484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:13.273508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.274054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.274517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.275205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.275653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.276623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.398213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-631112724", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1356466823", "security_groups": [{"name": "tempest-secgroup-smoke-306983037"}], "block_device_mapping_v2": [{"uuid": "16f53961-8a96-4ab4-8165-499c10be8d32", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7abe6454-7fe6-4ac7-b3ad-227b22f373e8"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:13.413208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:13.421110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e8708f6c-fd83-4133-93ea-b632a413e15c tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1318 microversion: 2.1 time: 0.158866 Oct 02 01:03:13.421540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 398/801] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:13 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:13.511529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] validate_networks() for [('7abe6454-7fe6-4ac7-b3ad-227b22f373e8', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:03:13.873607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:13.874031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:13.874536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:13.874947 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:13.875354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:13.884082 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.884561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.885027 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.885747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:13.886234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:13.886666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:13.902764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Getting quotas for project 017c596a2d0f430d987352a616666610. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:13.906722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Getting quotas for user a94a5f91289c403cb49f428e53431591 and project 017c596a2d0f430d987352a616666610. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:13.961685 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:03:13.963873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16f53961-8a96-4ab4-8165-499c10be8d32',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:03:14.087816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-beb7b970-7906-480d-a067-50d05e3608a1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.693393 Oct 02 01:03:14.088649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 404/802] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:03:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 02 01:03:14.099375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-770d8956-dae1-4ccd-a5c2-4b50b85d31e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:14.099987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-770d8956-dae1-4ccd-a5c2-4b50b85d31e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:14.156789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-770d8956-dae1-4ccd-a5c2-4b50b85d31e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:14.164154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-770d8956-dae1-4ccd-a5c2-4b50b85d31e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1094 microversion: 2.1 time: 0.068496 Oct 02 01:03:14.165043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 399/803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:14 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:14.444509 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:14.445245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:14.451547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:14.452027 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:14.452460 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:14.453150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:14.453647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:14.454035 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:14.587336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:14.595641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15144d7a-8372-4c9f-b172-30eb539b7018 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1318 microversion: 2.1 time: 0.155642 Oct 02 01:03:14.596204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 405/804] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:14 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:15.187756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:15.188373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:15.195501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:15.195995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:15.196587 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:15.197148 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:15.198325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:15.198760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:15.262013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:15.270176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-04f7f007-4285-42bd-a06c-462253195f63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1192 microversion: 2.1 time: 0.086177 Oct 02 01:03:15.270748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 400/805] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:15 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:15.618285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:15.618814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:15.625962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:15.626479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:15.626907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:15.627587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:15.628032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:15.628455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:15.801091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-5d061a91-d3af-4d7a-8fed-a66c8822f445 req-b0dcb99c-8b51-4de9-a282-45f27aab2405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8cdad-5bc0-4363-8cb6-57858ca90ec8", "name": "network-vif-plugged", "status": "completed", "tag": "573fe390-6f7d-4e24-927b-0186ee9e131e"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:15.813039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5d061a91-d3af-4d7a-8fed-a66c8822f445 req-b0dcb99c-8b51-4de9-a282-45f27aab2405 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:15.813712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5d061a91-d3af-4d7a-8fed-a66c8822f445 req-b0dcb99c-8b51-4de9-a282-45f27aab2405 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:15.814418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-5d061a91-d3af-4d7a-8fed-a66c8822f445 req-b0dcb99c-8b51-4de9-a282-45f27aab2405 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:15.828696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-5d061a91-d3af-4d7a-8fed-a66c8822f445 req-b0dcb99c-8b51-4de9-a282-45f27aab2405 service nova] Creating event network-vif-plugged:573fe390-6f7d-4e24-927b-0186ee9e131e for instance b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 on hv-cinder-maste Oct 02 01:03:15.834701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-5d061a91-d3af-4d7a-8fed-a66c8822f445 req-b0dcb99c-8b51-4de9-a282-45f27aab2405 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037380 Oct 02 01:03:15.835654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 401/806] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:15.839287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:15.852472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e46fc90c-334e-41a3-892d-7ed314024ca8 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1318 microversion: 2.1 time: 0.238163 Oct 02 01:03:15.853074 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 406/807] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:15 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:16.293841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:16.294575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:16.300683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:16.301166 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:16.301595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:16.302318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:16.302768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:16.303195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:16.430658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:16.438828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0f6737a8-12c1-4c1c-b050-1fded9bfcb3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.149812 Oct 02 01:03:16.439387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 402/808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:16 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:16.876003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:16.876713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:16.883422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:16.884020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:16.884456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:16.885648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:16.886114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:16.886538 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:17.136675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:17.144821 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2750d1b2-a7cc-4030-9324-5382cd21a6ea tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1318 microversion: 2.1 time: 0.272691 Oct 02 01:03:17.145394 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 407/809] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:16 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:17.415435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-ea652c1f-086d-4974-ba8e-b90aff9a971d req-8ede323c-95fd-4f77-9a8a-7a85aed707e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c321dc-02fa-4499-b40f-35a4d2409bae", "tag": "807ec6f3-5032-4e60-8c4d-a4607a99b2ab"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:17.425147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-ea652c1f-086d-4974-ba8e-b90aff9a971d req-8ede323c-95fd-4f77-9a8a-7a85aed707e6 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:17.425626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-ea652c1f-086d-4974-ba8e-b90aff9a971d req-8ede323c-95fd-4f77-9a8a-7a85aed707e6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:17.426085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-ea652c1f-086d-4974-ba8e-b90aff9a971d req-8ede323c-95fd-4f77-9a8a-7a85aed707e6 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:17.437075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-ea652c1f-086d-4974-ba8e-b90aff9a971d req-8ede323c-95fd-4f77-9a8a-7a85aed707e6 service nova] Creating event network-changed:807ec6f3-5032-4e60-8c4d-a4607a99b2ab for instance 46c321dc-02fa-4499-b40f-35a4d2409bae on hv-cinder-maste Oct 02 01:03:17.442391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-ea652c1f-086d-4974-ba8e-b90aff9a971d req-8ede323c-95fd-4f77-9a8a-7a85aed707e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030268 Oct 02 01:03:17.446044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 403/810] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:17.461482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:17.462108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:17.468171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:17.468648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:17.469079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:17.469757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:17.470248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:17.470669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:17.604136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:17.611943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a993e8b8-9ecb-4cf7-894e-e3d5a4d33027 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.154273 Oct 02 01:03:17.612505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 408/811] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:17 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:18.169732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:18.170375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:18.176509 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.177074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.177517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.178244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.178699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.179121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.389314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:18.397074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fabd0773-629b-41ac-aed2-9cc53e7c00a5 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1507 microversion: 2.1 time: 0.232200 Oct 02 01:03:18.397856 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 404/812] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:18 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:18.419564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56ec7612-1c19-41f4-abf0-19e6209b4f8e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91554072-1917-4b09-9c08-9d0a44183351", "device": "/dev/sdb"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:18.422305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56ec7612-1c19-41f4-abf0-19e6209b4f8e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:18.428567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56ec7612-1c19-41f4-abf0-19e6209b4f8e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.429045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56ec7612-1c19-41f4-abf0-19e6209b4f8e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.429477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56ec7612-1c19-41f4-abf0-19e6209b4f8e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.430244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56ec7612-1c19-41f4-abf0-19e6209b4f8e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.430695 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56ec7612-1c19-41f4-abf0-19e6209b4f8e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.431113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56ec7612-1c19-41f4-abf0-19e6209b4f8e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.635459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:18.636080 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:18.638492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:18.643745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.644229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.644660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.645352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:18.645799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:18.646481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:18.683827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56ec7612-1c19-41f4-abf0-19e6209b4f8e tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "POST /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268115 Oct 02 01:03:18.684694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 409/813] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:03:18 2022] POST /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:18.779802 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:18.787433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-06ec9525-1e08-46e7-82fc-2f14eb033253 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.156521 Oct 02 01:03:18.787986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 405/814] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:18 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:19.811377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:19.811981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:19.818326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:19.818807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:19.819239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:19.819924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:19.820374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:19.820795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:19.953995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:19.961945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90069668-9f21-468b-90ad-605f5c07b66e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.155711 Oct 02 01:03:19.962532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 410/815] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:19 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:20.985514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:20.986152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:20.992846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:20.993325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:20.993761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:20.994478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:20.994934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:20.995366 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:21.123087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:21.130812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7d61e813-90f4-47da-b65d-93282da7a916 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.149129 Oct 02 01:03:21.131377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 406/816] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:20 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:22.153221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:22.153756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:22.160499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:22.160975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:22.161404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:22.162102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:22.162556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:22.162974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:22.302358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:22.310918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4770f90-fccd-44b5-94de-76f64ad66966 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.161530 Oct 02 01:03:22.311536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 411/817] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:22 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:23.332777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:23.333384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:23.340305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.340785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.341250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.341948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:23.342449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:23.342877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:23.469652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:23.477275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e2611dc0-33db-469f-94b2-fec443d0c2ee tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.148428 Oct 02 01:03:23.477836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 407/818] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:23 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:24.500403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:24.501006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:24.503423 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:24.504208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:24.510535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.511019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.511452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.512193 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:24.512647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:24.513072 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:24.641709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:24.649354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cd3d081-cf73-492e-9d86-0839c3630778 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.152787 Oct 02 01:03:24.649906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 412/819] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:24 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:25.672980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:25.673594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:25.675453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=8 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:25.681307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:25.681795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:25.682292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:25.682995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:25.683456 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:25.683887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:25.820610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:25.829331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-71fdc973-0952-4fbd-95c3-b63321da85a8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.160138 Oct 02 01:03:25.829903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 408/820] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:25 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:26.030922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aeeb36df-b187-47d7-9fd5-3557eeb71b56 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:26.031415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aeeb36df-b187-47d7-9fd5-3557eeb71b56 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:26.037796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aeeb36df-b187-47d7-9fd5-3557eeb71b56 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.038322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aeeb36df-b187-47d7-9fd5-3557eeb71b56 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.038762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aeeb36df-b187-47d7-9fd5-3557eeb71b56 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.039453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aeeb36df-b187-47d7-9fd5-3557eeb71b56 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.039908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aeeb36df-b187-47d7-9fd5-3557eeb71b56 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.040332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aeeb36df-b187-47d7-9fd5-3557eeb71b56 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.062702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aeeb36df-b187-47d7-9fd5-3557eeb71b56 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498/ips" status: 200 len: 149 microversion: 2.1 time: 0.035701 Oct 02 01:03:26.063298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 413/821] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 01:03:26 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:26.075200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:26.077529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:26.083434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.083917 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.084354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.085044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.085499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.085922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Invalid volume: volume 1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e is already attached to instances: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: POST /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498/os-volume_attachments HTTP/1.1 Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 74 Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:03:26.173612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {"volumeAttachment": {"volumeId": "1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e"}} Oct 02 01:03:26.176864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Invalid volume: volume 1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e is already attached to instances: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'server_id': 'b21532c9-c67d-40e7-a8c2-56989e7f2498', 'body': {'volumeAttachment': {'volumeId': '1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e'}}} Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e is already attached to instances: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:03:26.177731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e is already attached to instances: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:26.179514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:26.180977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:26.180977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:26.180977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:26.180977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e is already attached to instances: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 Oct 02 01:03:26.180977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:03:26.180977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 400 to user: Invalid volume: volume 1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e is already attached to instances: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:26.180977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-02f6017c-2c0e-4d85-a320-9f43f8451d3a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103952 Oct 02 01:03:26.180977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 409/822] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:03:26 2022] POST /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:03:26.184801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:26.185735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:26.191878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.192535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.192975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.193675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.194200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.194630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.222731 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:26.308466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a41ad2e-56b5-4a36-93b9-1607826b0aa4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 204 len: 0 microversion: 2.1 time: 0.128276 Oct 02 01:03:26.312326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 414/823] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:26 2022] DELETE /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:26.320161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:26.321659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:26.331686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.332556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.333159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.335504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.336570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.337070 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.476249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:26.484077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-19fd5e9d-2ce1-4901-b030-fbdeab77f451 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1681 microversion: 2.1 time: 0.170088 Oct 02 01:03:26.484648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 410/824] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:26 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:26.853831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:26.854561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:26.860790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.861194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.861629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.862368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:26.863219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:26.863510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:26.997198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:27.004918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ab0716d-b131-4968-9b4a-b1959db5468d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.155895 Oct 02 01:03:27.005479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 415/825] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:26 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:27.509067 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:27.509720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:27.516430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.516920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.517368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.518083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:27.518553 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:27.519064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:27.649647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:27.657359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a30f9a9d-686a-498d-bef4-8e70a18e33ba tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1681 microversion: 2.1 time: 0.152393 Oct 02 01:03:27.657921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 411/826] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:27 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:28.028705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:28.029376 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:28.035840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:28.036324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:28.036950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.037448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:28.037904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:28.038356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.056418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:28.172289 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:28.180035 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b6e44877-cbaa-4e81-be6d-900e07d46921 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.155725 Oct 02 01:03:28.180621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 416/827] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:28 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:28.680975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:28.682054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:28.688074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:28.688552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:28.688987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.689675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:28.690154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:28.690578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:28.816907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:28.824515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ecc510a1-8976-44af-8bf8-8e73ee9e7244 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1681 microversion: 2.1 time: 0.147691 Oct 02 01:03:28.825084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 412/828] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:28 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:29.202615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:29.203223 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:29.209600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.210098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.210534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:29.211220 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.211668 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.212085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:29.338762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:29.346296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15c67388-e636-4cec-bbf3-e1e0a080182d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.147466 Oct 02 01:03:29.346852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 417/829] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:29 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:29.846331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:29.846953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:29.854230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.854718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.855157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:29.855848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:29.856304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:29.856728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:29.990593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:29.998780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fb4c6870-f591-45f2-ae33-015d4c73b503 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1681 microversion: 2.1 time: 0.156344 Oct 02 01:03:30.014226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 413/830] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:29 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:30.147330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d132d093-15fa-42c5-918c-e3feb04d0504 req-2b027ff7-0141-4f86-9e5f-9bc6949db656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c321dc-02fa-4499-b40f-35a4d2409bae", "name": "network-vif-plugged", "status": "completed", "tag": "807ec6f3-5032-4e60-8c4d-a4607a99b2ab"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:30.157661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d132d093-15fa-42c5-918c-e3feb04d0504 req-2b027ff7-0141-4f86-9e5f-9bc6949db656 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:30.158175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d132d093-15fa-42c5-918c-e3feb04d0504 req-2b027ff7-0141-4f86-9e5f-9bc6949db656 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:30.158682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d132d093-15fa-42c5-918c-e3feb04d0504 req-2b027ff7-0141-4f86-9e5f-9bc6949db656 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:30.170837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d132d093-15fa-42c5-918c-e3feb04d0504 req-2b027ff7-0141-4f86-9e5f-9bc6949db656 service nova] Creating event network-vif-plugged:807ec6f3-5032-4e60-8c4d-a4607a99b2ab for instance 46c321dc-02fa-4499-b40f-35a4d2409bae on hv-cinder-maste Oct 02 01:03:30.175649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d132d093-15fa-42c5-918c-e3feb04d0504 req-2b027ff7-0141-4f86-9e5f-9bc6949db656 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032243 Oct 02 01:03:30.176437 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 418/831] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:30.370588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:30.371574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:30.378222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:30.378978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:30.379645 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:30.380368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:30.380823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:30.381267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:30.683577 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:30.691309 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d94745be-53ef-49a0-ab2c-86cfecad113c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.325015 Oct 02 01:03:30.692159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 414/832] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:30 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:30.996720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0d8685d2-cd56-4bc5-b308-2e722dbe5d15 req-ee0b7e43-2e9a-43d2-bee6-6919b72ae6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21532c9-c67d-40e7-a8c2-56989e7f2498", "name": "network-vif-deleted", "tag": "4a9965b5-643d-4478-8378-7760d8362e4f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:31.006235 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0d8685d2-cd56-4bc5-b308-2e722dbe5d15 req-ee0b7e43-2e9a-43d2-bee6-6919b72ae6c0 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.006717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0d8685d2-cd56-4bc5-b308-2e722dbe5d15 req-ee0b7e43-2e9a-43d2-bee6-6919b72ae6c0 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.007142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0d8685d2-cd56-4bc5-b308-2e722dbe5d15 req-ee0b7e43-2e9a-43d2-bee6-6919b72ae6c0 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.018411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0d8685d2-cd56-4bc5-b308-2e722dbe5d15 req-ee0b7e43-2e9a-43d2-bee6-6919b72ae6c0 service nova] Creating event network-vif-deleted:4a9965b5-643d-4478-8378-7760d8362e4f for instance b21532c9-c67d-40e7-a8c2-56989e7f2498 on hv-cinder-maste Oct 02 01:03:31.021446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:31.022213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:31.024041 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0d8685d2-cd56-4bc5-b308-2e722dbe5d15 req-ee0b7e43-2e9a-43d2-bee6-6919b72ae6c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031466 Oct 02 01:03:31.025250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 419/833] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:31.032524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.033237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.033686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.034461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.036731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.037208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.042158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:31.106376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:31.115342 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7ab3c25d-1199-4ec8-a002-bbf95597f23e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1613 microversion: 2.1 time: 0.097579 Oct 02 01:03:31.115913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 415/834] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:31 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:31.715898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:31.716647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:31.723023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.723511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.723951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.724660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:31.725122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:31.725555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:31.865725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:31.873727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b827068c-0546-4d20-9f75-2616c93d1c60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.162510 Oct 02 01:03:31.874530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 420/835] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:31 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:32.139327 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:32.139896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:32.146324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.146801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.147232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.147915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.148362 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.148780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.209391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:32.216994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1bd6c23b-3a72-41e6-9cd7-317f13dad4b1 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1613 microversion: 2.1 time: 0.081612 Oct 02 01:03:32.217548 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 416/836] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:32 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1613 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:32.896660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:32.897276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:32.904302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.904788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.905231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:32.905927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:32.906426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:32.906859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.038917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:33.047352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d43cf5fe-a36e-43fc-92fc-81987c39a4f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.154587 Oct 02 01:03:33.047923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 421/837] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:32 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:33.240115 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:33.240663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:33.247063 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.247542 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.247973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.248659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:33.249127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:33.249532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:33.309725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:33.317283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9e950cf1-16cd-4776-8956-48e28cadf48f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1613 microversion: 2.1 time: 0.081267 Oct 02 01:03:33.317835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 417/838] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:33 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1613 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:34.071406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:34.072041 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:34.079182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.079669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.080100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.080789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.081241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.081659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.215666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:34.223459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cc639aa-771d-449d-9b47-3764b8689d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1265 microversion: 2.1 time: 0.157475 Oct 02 01:03:34.224014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 422/839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:34 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:34.340397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:34.341008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:34.347531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.348016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.348449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.349137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.349588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.350012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.380943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:34.381404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:34.381842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:34.382320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lazy-loading 'fault' on Instance uuid b21532c9-c67d-40e7-a8c2-56989e7f2498 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:34.424955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:34.432394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-99b2ab61-1ed4-4729-8f76-61fbbca9f8ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 200 len: 1331 microversion: 2.1 time: 0.095817 Oct 02 01:03:34.432957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 418/840] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:34 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:35.247151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:35.247771 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:35.254416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.254905 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.255338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.256041 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.256499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.256927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.390453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:35.398385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e51575fc-d56f-4975-862f-103bbfa22fb6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1452 microversion: 2.1 time: 0.155235 Oct 02 01:03:35.398943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 423/841] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:35 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:35.420186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:35.420797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:35.427386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.427892 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.428374 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.429099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.429579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.430002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.455352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:35.455957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:35.461850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.462369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.462795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.463478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:35.463930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:35.464352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:35.477631 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 HTTP/1.1 Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:03:35.479318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:03:35.480805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': 'b21532c9-c67d-40e7-a8c2-56989e7f2498'} Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:35.481607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:03:35.482906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:35.484048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:35.484048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65260196-d854-4330-bd86-2b6e5604ec03 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 404 len: 111 microversion: 2.1 time: 0.029305 Oct 02 01:03:35.484048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 424/842] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:35 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:03:35.489435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bce55272-63e4-4c6b-963d-1dff620543e2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '.version_select at 0x7f6e78e8c430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:35.508116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bce55272-63e4-4c6b-963d-1dff620543e2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-374502255" status: 202 len: 0 microversion: 2.1 time: 0.022381 Oct 02 01:03:35.508690 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 425/843] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Oct 2 01:03:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-374502255 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:03:35.595625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:35.603504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-786b1b71-93e0-4fde-a29f-da149f0a5a78 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1452 microversion: 2.1 time: 0.187101 Oct 02 01:03:35.604911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 419/844] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:35 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:36.300006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:36.300539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:36.307412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.308097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.308711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.309592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.310023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.310476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.391800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lazy-loading 'services' on Instance uuid 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:36.462286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3fc92d18-0224-4103-9de3-9e0d0d675d4f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-volume_attachments/1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e" status: 202 len: 0 microversion: 2.1 time: 0.166773 Oct 02 01:03:36.463234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 426/845] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 01:03:36 2022] DELETE /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-volume_attachments/1efbccb7-f0ed-4217-b4b0-1f8cb7d5fa6e => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:03:36.471523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fcf4234b-1015-4d57-b996-adb537ed2b93 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:36.474983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fcf4234b-1015-4d57-b996-adb537ed2b93 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:36.482102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fcf4234b-1015-4d57-b996-adb537ed2b93 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.482369 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fcf4234b-1015-4d57-b996-adb537ed2b93 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.482790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fcf4234b-1015-4d57-b996-adb537ed2b93 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.483730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fcf4234b-1015-4d57-b996-adb537ed2b93 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:36.484350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fcf4234b-1015-4d57-b996-adb537ed2b93 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:36.484934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fcf4234b-1015-4d57-b996-adb537ed2b93 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:36.518314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fcf4234b-1015-4d57-b996-adb537ed2b93 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050549 Oct 02 01:03:36.522256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 420/846] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:03:36 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:37.532049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a548d28-9f04-4260-a3a2-a99bd4490b7f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:37.534268 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a548d28-9f04-4260-a3a2-a99bd4490b7f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.540849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a548d28-9f04-4260-a3a2-a99bd4490b7f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.541331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a548d28-9f04-4260-a3a2-a99bd4490b7f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.542396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a548d28-9f04-4260-a3a2-a99bd4490b7f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.543093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a548d28-9f04-4260-a3a2-a99bd4490b7f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.543739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a548d28-9f04-4260-a3a2-a99bd4490b7f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.544166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a548d28-9f04-4260-a3a2-a99bd4490b7f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.572649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a548d28-9f04-4260-a3a2-a99bd4490b7f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045001 Oct 02 01:03:37.573217 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 427/847] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:03:37 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:03:37.638629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:37.639296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.657036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.657600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.658126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.658895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.659414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.660002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.661558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d077c732-d680-4e2e-b438-3637f4532ba4 req-d1f19cdf-7ea6-4cdc-8a32-167910e1e4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c321dc-02fa-4499-b40f-35a4d2409bae", "tag": "807ec6f3-5032-4e60-8c4d-a4607a99b2ab"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:37.671648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d077c732-d680-4e2e-b438-3637f4532ba4 req-d1f19cdf-7ea6-4cdc-8a32-167910e1e4ee service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.672132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d077c732-d680-4e2e-b438-3637f4532ba4 req-d1f19cdf-7ea6-4cdc-8a32-167910e1e4ee service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.672559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d077c732-d680-4e2e-b438-3637f4532ba4 req-d1f19cdf-7ea6-4cdc-8a32-167910e1e4ee service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.684318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d077c732-d680-4e2e-b438-3637f4532ba4 req-d1f19cdf-7ea6-4cdc-8a32-167910e1e4ee service nova] Creating event network-changed:807ec6f3-5032-4e60-8c4d-a4607a99b2ab for instance 46c321dc-02fa-4499-b40f-35a4d2409bae on hv-cinder-maste Oct 02 01:03:37.689760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d077c732-d680-4e2e-b438-3637f4532ba4 req-d1f19cdf-7ea6-4cdc-8a32-167910e1e4ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031690 Oct 02 01:03:37.690431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:37.690984 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 428/848] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:37.778109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e0585213-5d29-4eb2-a16e-5b7dd4e8a2a8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 204 len: 0 microversion: 2.1 time: 0.142985 Oct 02 01:03:37.779415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 421/849] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:37 2022] DELETE /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:03:37.790319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:37.790947 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:37.797126 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.797617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.798081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.798831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:37.799303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:37.799731 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:37.931442 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:37.939639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31d75850-ce3a-40b5-84c8-2e113905c9ee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1682 microversion: 2.1 time: 0.155122 Oct 02 01:03:37.940453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 429/850] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:37 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:38.119393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:38.120024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:38.126550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.127038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.127474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.128193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.128642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.129239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.213953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lazy-loading 'services' on Instance uuid b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:38.288302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7220f4e5-df5e-435f-8c96-73b2142319bc tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8/os-volume_attachments/91554072-1917-4b09-9c08-9d0a44183351" status: 202 len: 0 microversion: 2.1 time: 0.172971 Oct 02 01:03:38.288908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 422/851] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 01:03:38 2022] DELETE /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8/os-volume_attachments/91554072-1917-4b09-9c08-9d0a44183351 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:38.963092 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:38.964142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:38.966601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:38.971766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.972242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.972673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:38.973360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:38.973808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:38.974257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:39.104757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:39.112716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2897888-8770-42e0-8e4b-27d8a698f655 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1682 microversion: 2.1 time: 0.153321 Oct 02 01:03:39.113279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 430/852] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:38 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:40.138769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:40.139523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:40.142316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:40.148072 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.148566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.149005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.149745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.150232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.150661 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.467273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:40.469121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:40.470621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:40.475668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-95c40b92-4789-4f9b-8cff-011dec9db4a6 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1682 microversion: 2.1 time: 0.341776 Oct 02 01:03:40.480225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 423/853] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:40 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1682 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:40.480371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.480371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.480371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.480371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.480750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.480750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.506163 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:03:40.586526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e8a47af-92ca-41ef-a5dd-d4cff63c5cc9 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 204 len: 0 microversion: 2.1 time: 0.120886 Oct 02 01:03:40.587230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 431/854] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:03:40 2022] DELETE /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 02 01:03:40.597478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:40.597694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:40.603686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.604173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.604712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.605913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:40.606393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:40.606819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:40.813359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:40.821420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-78ecc716-b314-4e92-bf34-5e31091fc222 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1513 microversion: 2.1 time: 0.228441 Oct 02 01:03:40.822096 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 424/855] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:40 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:03:41.193615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cd1bdeb8-081f-47eb-9089-f6d2519b1aef req-039d1870-299e-407f-983c-261fe9e6f44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1", "name": "network-vif-deleted", "tag": "a3f6bd30-fd03-41e0-ae97-4ad1d8dc82cd"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:41.203678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd1bdeb8-081f-47eb-9089-f6d2519b1aef req-039d1870-299e-407f-983c-261fe9e6f44b service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.204156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd1bdeb8-081f-47eb-9089-f6d2519b1aef req-039d1870-299e-407f-983c-261fe9e6f44b service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.204582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd1bdeb8-081f-47eb-9089-f6d2519b1aef req-039d1870-299e-407f-983c-261fe9e6f44b service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.215749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cd1bdeb8-081f-47eb-9089-f6d2519b1aef req-039d1870-299e-407f-983c-261fe9e6f44b service nova] Creating event network-vif-deleted:a3f6bd30-fd03-41e0-ae97-4ad1d8dc82cd for instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 on hv-cinder-maste Oct 02 01:03:41.220540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cd1bdeb8-081f-47eb-9089-f6d2519b1aef req-039d1870-299e-407f-983c-261fe9e6f44b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031156 Oct 02 01:03:41.221122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 432/856] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:41.500152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:41.500838 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:41.507266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.507820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.508255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.508939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.509387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.509803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.571110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:41.578772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b15a4bd9-4f8d-4379-b39c-a820eb5de06f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1614 microversion: 2.1 time: 0.082481 Oct 02 01:03:41.579339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 425/857] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:41 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:41.846369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:41.846982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:41.853076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.853556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.854560 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.855260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:41.855711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:41.856136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:41.999902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:42.007935 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4159bdbb-7528-4e61-a531-7ec49be4ba45 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1513 microversion: 2.1 time: 0.166370 Oct 02 01:03:42.008539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 433/858] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:41 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:42.600668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:42.601292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:42.609478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:42.609975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:42.610438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:42.611158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:42.611673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:42.612550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:42.646499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:42.646985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:42.647614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:42.648064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lazy-loading 'fault' on Instance uuid 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:03:42.698925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:42.706673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-34f0f0d5-9732-4c7b-aebb-b10f032aaf4d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 200 len: 1331 microversion: 2.1 time: 0.109766 Oct 02 01:03:42.707238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 426/859] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:42 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:43.031382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:43.031939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:43.044080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.044649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.045777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.046620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.047194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.047689 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.122036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c6036067e4ed2817f56d95eaf1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b72d052142491dbfc1936f4f006715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:43.130640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b29b7e83-bdd5-40f3-9c36-92b8f2526f95 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 200 len: 1471 microversion: 2.1 time: 0.103257 Oct 02 01:03:43.131379 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 434/860] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:43 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 1471 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:43.234877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-e9f827a1-54b4-43eb-9999-eb423d762570 req-50eeea4f-f108-4efc-b96b-f0de79a4095c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8cdad-5bc0-4363-8cb6-57858ca90ec8", "name": "network-vif-deleted", "tag": "573fe390-6f7d-4e24-927b-0186ee9e131e"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:43.244518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e9f827a1-54b4-43eb-9999-eb423d762570 req-50eeea4f-f108-4efc-b96b-f0de79a4095c service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.244994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e9f827a1-54b4-43eb-9999-eb423d762570 req-50eeea4f-f108-4efc-b96b-f0de79a4095c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.245416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-e9f827a1-54b4-43eb-9999-eb423d762570 req-50eeea4f-f108-4efc-b96b-f0de79a4095c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.256258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-e9f827a1-54b4-43eb-9999-eb423d762570 req-50eeea4f-f108-4efc-b96b-f0de79a4095c service nova] Creating event network-vif-deleted:573fe390-6f7d-4e24-927b-0186ee9e131e for instance b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 on hv-cinder-maste Oct 02 01:03:43.262036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-e9f827a1-54b4-43eb-9999-eb423d762570 req-50eeea4f-f108-4efc-b96b-f0de79a4095c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030764 Oct 02 01:03:43.262624 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 427/861] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:03:43.729815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:43.730493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:43.736987 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.737748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.738218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.738914 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:43.739371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:43.739803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:43.743956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:43.754946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 HTTP/1.1 Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:03:43.756734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:03:43.758335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1'} Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:43.759244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:03:43.761134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:43.762734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:43.762734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b87b0ff-e794-43a3-97a3-f6fe0011366f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 404 len: 111 microversion: 2.1 time: 0.032204 Oct 02 01:03:43.762734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 435/862] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:43 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:43.768325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b9edca21-25e3-407b-9997-39a2c5777182 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '.version_select at 0x7f6e78dc4e50>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:43.787956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b9edca21-25e3-407b-9997-39a2c5777182 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467545146" status: 202 len: 0 microversion: 2.1 time: 0.024169 Oct 02 01:03:43.788656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 428/863] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Oct 2 01:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467545146 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:03:44.155600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:44.156310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] [instance: b5c8cdad-5bc0-4363-8cb6-57858ca90ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:44.164042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.164528 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.164973 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.165677 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:44.166164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:44.166595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:44.180469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] HTTP exception thrown: Instance b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 could not be found. Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Request method failure captured: Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 HTTP/1.1 Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOMAqx4Qc30uFUbxsKS5MhNBrTEdCGHFuoE82VTJUeFCjW37_WLSTQffsTDloT7-y6ejxWz73lqLbA05z7UkoMBYGCInRwtoLbUVIJN2bJyKfkDpMrWOeCUMF24Xz_UMZ-8dap5PtVb-2CQIp2c5eZBSJJ0T9S9y2lXNIGNkaH-asNE Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 31b72d052142491dbfc1936f4f006715 Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2044369547 Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:03:44.182915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31b72d052142491dbfc1936f4f006715"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31b72d052142491dbfc1936f4f006715"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31b72d052142491dbfc1936f4f006715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31b72d052142491dbfc1936f4f006715"}]}] Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotTestJSON-2044369547 Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 31b72d052142491dbfc1936f4f006715 Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2044369547 Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotTestJSON-2044369547-project Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: a84c6036067e4ed2817f56d95eaf1715 Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotTestJSON-2044369547-project Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 could not be found. Oct 02 01:03:44.184364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': 'b5c8cdad-5bc0-4363-8cb6-57858ca90ec8'} Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 could not be found. Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:03:44.185272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 could not be found. Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 could not be found. Oct 02 01:03:44.186761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:03:44.188707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] Returning 404 to user: Instance b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:03:44.188707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ad086f6-fb4b-41c6-a248-15bfda95bd82 tempest-VolumesSnapshotTestJSON-2044369547 tempest-VolumesSnapshotTestJSON-2044369547-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8" status: 404 len: 111 microversion: 2.1 time: 0.033523 Oct 02 01:03:44.188707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 436/864] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:44 2022] GET /compute/v2.1/servers/b5c8cdad-5bc0-4363-8cb6-57858ca90ec8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:03:44.393239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b57df885-ee7e-4687-ba59-bc961404fe22 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: .version_select at 0x7f6e78da20d0>, body: {"keypair": {"name": "tempest-keypair-984897730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhw/b88aM3/MJysolqOo0N6EGDN5TBmfbBkcdYUwmyp/yO/67M36wIwbj4PECxU3L5XxJ8/8H7MLHFM6oLRe9j0xyPtZGA8osmneGXRGk25w+XU8ks4cu4EZkafpweoYg=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:44.415982 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-b57df885-ee7e-4687-ba59-bc961404fe22 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for project 29870f31b41846cc923a28ebfaf368db. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:44.424369 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-b57df885-ee7e-4687-ba59-bc961404fe22 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for user 1750f2cc69c0499ebade616da183507b and project 29870f31b41846cc923a28ebfaf368db. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:44.453626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b57df885-ee7e-4687-ba59-bc961404fe22 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064806 Oct 02 01:03:44.454497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 429/865] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 01:03:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:45.708215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-791509030", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "187441bc-85a8-46c2-a472-a2fcaf6bcd79"}], "security_groups": [{"name": "tempest-securitygroup--2068054123"}], "key_name": "tempest-keypair-984897730", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:45.812102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] validate_networks() for [('187441bc-85a8-46c2-a472-a2fcaf6bcd79', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:03:46.173810 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:03:46.174269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:03:46.174747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:03:46.175158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:03:46.175571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:03:46.184918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:46.185396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:46.185828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:46.186666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:46.187122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:46.187547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:46.203790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for project 29870f31b41846cc923a28ebfaf368db. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:03:46.207740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for user 1750f2cc69c0499ebade616da183507b and project 29870f31b41846cc923a28ebfaf368db. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:03:46.218625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:03:46.220885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:03:46.267730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b721c82-9816-40da-8775-5260ca4e960e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564619 Oct 02 01:03:46.268374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 437/866] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:03:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:03:46.280135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9d50939a-fa1b-44ce-ad72-68d4f910fce8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:46.280877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9d50939a-fa1b-44ce-ad72-68d4f910fce8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:46.337406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9d50939a-fa1b-44ce-ad72-68d4f910fce8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:46.344593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9d50939a-fa1b-44ce-ad72-68d4f910fce8 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1240 microversion: 2.1 time: 0.068974 Oct 02 01:03:46.345360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 430/867] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:46 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:47.367177 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:47.367813 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:47.375475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:47.375951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:47.376383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:47.377069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:47.377540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:47.377961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:47.437081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:47.444780 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16f0f66d-75ca-4b5a-ac77-999ee60ed27e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1244 microversion: 2.1 time: 0.081523 Oct 02 01:03:47.445337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 438/868] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:47 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:48.468049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:48.468568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:48.475236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.475714 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.476146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.476837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:48.477291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:48.477709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:48.553807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:48.562378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4610db41-16c9-489a-8b09-bd895faa8552 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1244 microversion: 2.1 time: 0.098196 Oct 02 01:03:48.562958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 431/869] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:48 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:49.585801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:49.586647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:49.594141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:49.594635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:49.595077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:49.595792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:49.596248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:49.596704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:49.831848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:49.839787 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a20a69e0-10e1-4bb5-9ab5-18602151d65e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1298 microversion: 2.1 time: 0.258499 Oct 02 01:03:49.840293 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 439/870] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:49 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1298 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:50.864288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:50.864907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:50.871369 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.871847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.872277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.872967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:50.873473 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:50.873897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:50.892591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:51.080103 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:51.087610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d0060d09-3e35-4486-845b-2368253b4fc2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1366 microversion: 2.1 time: 0.227443 Oct 02 01:03:51.088221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 432/871] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:50 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:51.131473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-48572ab9-c46c-4594-8c22-3778efe57a73 req-0e39eca6-6771-44ee-8e6a-8cdaf908e599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f829b4d-e5ad-48c1-82e8-c36676302a92", "tag": "eb9ad07a-6799-41b1-91f6-ce5378b2cf93"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:51.147029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48572ab9-c46c-4594-8c22-3778efe57a73 req-0e39eca6-6771-44ee-8e6a-8cdaf908e599 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:51.147432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48572ab9-c46c-4594-8c22-3778efe57a73 req-0e39eca6-6771-44ee-8e6a-8cdaf908e599 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:51.147871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-48572ab9-c46c-4594-8c22-3778efe57a73 req-0e39eca6-6771-44ee-8e6a-8cdaf908e599 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:51.158967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-48572ab9-c46c-4594-8c22-3778efe57a73 req-0e39eca6-6771-44ee-8e6a-8cdaf908e599 service nova] Creating event network-changed:eb9ad07a-6799-41b1-91f6-ce5378b2cf93 for instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 on hv-cinder-maste Oct 02 01:03:51.165494 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-48572ab9-c46c-4594-8c22-3778efe57a73 req-0e39eca6-6771-44ee-8e6a-8cdaf908e599 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037773 Oct 02 01:03:51.166242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 440/872] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:52.110141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:52.110764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:52.117375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.117860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.118332 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.119030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:52.119494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:52.119923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:52.245087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:52.252684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-13eaf6d9-840a-4e15-b37b-7a7650ae5841 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1366 microversion: 2.1 time: 0.146429 Oct 02 01:03:52.253251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 433/873] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:52 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:53.276053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:53.276909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:53.283646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:53.284132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:53.284570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:53.285263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:53.285722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:53.286177 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:53.416527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:53.424137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-073fb034-02d6-4d9a-acd7-efe4de287ece tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1366 microversion: 2.1 time: 0.152701 Oct 02 01:03:53.424698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 441/874] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:53 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:54.446889 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:54.447541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:54.453963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:54.454479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:54.454915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.455602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:54.456054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:54.456475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:54.580742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:54.588585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5129098f-65ae-4755-8daa-ac13ea5e9f52 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1366 microversion: 2.1 time: 0.145575 Oct 02 01:03:54.589148 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 434/875] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:54 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:55.610901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:55.611439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:55.618520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.619524 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.619964 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.620666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:55.621122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:55.621551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:55.745098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:55.752979 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9fb6fdd-9362-4309-9bfb-645fdb96be63 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1366 microversion: 2.1 time: 0.146069 Oct 02 01:03:55.753545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 442/876] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:55 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:56.775873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:56.776492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:56.778792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:56.784490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.784967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.785402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.786117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:56.786575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:56.786998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:56.915558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:56.924151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-471f279d-8858-435b-9076-3dbf1ed6a120 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1366 microversion: 2.1 time: 0.152144 Oct 02 01:03:56.924712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 435/877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:56 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:57.287238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8c7f9517-c39d-4b4f-92a6-37e8a0cbd512 req-535af0a3-99d1-4913-b5cc-fc8bf5731429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f829b4d-e5ad-48c1-82e8-c36676302a92", "name": "network-vif-plugged", "status": "completed", "tag": "eb9ad07a-6799-41b1-91f6-ce5378b2cf93"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:03:57.293200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:57.297682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:03:57.315909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8c7f9517-c39d-4b4f-92a6-37e8a0cbd512 req-535af0a3-99d1-4913-b5cc-fc8bf5731429 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.316393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8c7f9517-c39d-4b4f-92a6-37e8a0cbd512 req-535af0a3-99d1-4913-b5cc-fc8bf5731429 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.316824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8c7f9517-c39d-4b4f-92a6-37e8a0cbd512 req-535af0a3-99d1-4913-b5cc-fc8bf5731429 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:57.329894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8c7f9517-c39d-4b4f-92a6-37e8a0cbd512 req-535af0a3-99d1-4913-b5cc-fc8bf5731429 service nova] Creating event network-vif-plugged:eb9ad07a-6799-41b1-91f6-ce5378b2cf93 for instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 on hv-cinder-maste Oct 02 01:03:57.335632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8c7f9517-c39d-4b4f-92a6-37e8a0cbd512 req-535af0a3-99d1-4913-b5cc-fc8bf5731429 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052721 Oct 02 01:03:57.337044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 443/878] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:03:57.947967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:57.948537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:57.955207 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.955685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.956112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:57.956796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:57.957243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:57.957665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:58.085818 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:58.093362 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8060948c-13d5-45cc-bffb-abd4f24ca94a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1366 microversion: 2.1 time: 0.149964 Oct 02 01:03:58.093916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 436/879] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:57 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:03:59.117139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:03:59.117894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:03:59.124689 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:59.125165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:59.125650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:59.126312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:03:59.126761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:03:59.127181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:03:59.254742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:03:59.262625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-285d872b-f9e4-490e-bd14-710b2f857fa0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1366 microversion: 2.1 time: 0.150296 Oct 02 01:03:59.263208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 444/880] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:03:59 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:00.284782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:00.285395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:00.292914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:00.293336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:00.293778 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:00.294496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:00.294948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:00.295375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:00.425973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:00.434297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c28dd002-117c-44ff-ba33-c6c8d266fe40 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1556 microversion: 2.1 time: 0.153355 Oct 02 01:04:00.434857 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 437/881] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:00 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:00.456071 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a75376d-5f69-4a35-a827-2940fe7ef3ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:00.456561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a75376d-5f69-4a35-a827-2940fe7ef3ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:00.462934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a75376d-5f69-4a35-a827-2940fe7ef3ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:00.463414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a75376d-5f69-4a35-a827-2940fe7ef3ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:00.463848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a75376d-5f69-4a35-a827-2940fe7ef3ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:00.464537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a75376d-5f69-4a35-a827-2940fe7ef3ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:00.464990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a75376d-5f69-4a35-a827-2940fe7ef3ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:00.465411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a75376d-5f69-4a35-a827-2940fe7ef3ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:00.540281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a75376d-5f69-4a35-a827-2940fe7ef3ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087955 Oct 02 01:04:00.541434 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 445/882] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Oct 2 01:04:00 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:01.443401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-0c59624d-c605-457c-8201-b7963d7cd4ef req-0b510b19-06cd-42e1-b698-60d2c854bbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f829b4d-e5ad-48c1-82e8-c36676302a92", "tag": "eb9ad07a-6799-41b1-91f6-ce5378b2cf93"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:01.452963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-0c59624d-c605-457c-8201-b7963d7cd4ef req-0b510b19-06cd-42e1-b698-60d2c854bbb4 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:01.453435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-0c59624d-c605-457c-8201-b7963d7cd4ef req-0b510b19-06cd-42e1-b698-60d2c854bbb4 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:01.453859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-0c59624d-c605-457c-8201-b7963d7cd4ef req-0b510b19-06cd-42e1-b698-60d2c854bbb4 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:01.465237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-0c59624d-c605-457c-8201-b7963d7cd4ef req-0b510b19-06cd-42e1-b698-60d2c854bbb4 service nova] Creating event network-changed:eb9ad07a-6799-41b1-91f6-ce5378b2cf93 for instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 on hv-cinder-maste Oct 02 01:04:01.470384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-0c59624d-c605-457c-8201-b7963d7cd4ef req-0b510b19-06cd-42e1-b698-60d2c854bbb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030444 Oct 02 01:04:01.471044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 438/883] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:39.595698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:39.596549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=42 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:39.601083 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-524a419b-5051-446c-b053-02978779530b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:39.601598 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-524a419b-5051-446c-b053-02978779530b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:39.609761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524a419b-5051-446c-b053-02978779530b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.610272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524a419b-5051-446c-b053-02978779530b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.610706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524a419b-5051-446c-b053-02978779530b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.611647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524a419b-5051-446c-b053-02978779530b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:39.612095 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524a419b-5051-446c-b053-02978779530b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:39.612516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524a419b-5051-446c-b053-02978779530b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:39.635688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-524a419b-5051-446c-b053-02978779530b tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/ips" status: 200 len: 150 microversion: 2.1 time: 0.041735 Oct 02 01:04:39.636166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 446/884] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 01:04:39 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:40.960472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:40.961209 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=34 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:04:40.965668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-43fc24cf-5de9-4f1e-b06a-31a99171bcde tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c64b3d0-2b38-4bae-b401-0d1ad26f7760"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:40.968093 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-43fc24cf-5de9-4f1e-b06a-31a99171bcde tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:40.975988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fc24cf-5de9-4f1e-b06a-31a99171bcde tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.976477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fc24cf-5de9-4f1e-b06a-31a99171bcde tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.976916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fc24cf-5de9-4f1e-b06a-31a99171bcde tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:40.978128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fc24cf-5de9-4f1e-b06a-31a99171bcde tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:40.978595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fc24cf-5de9-4f1e-b06a-31a99171bcde tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:40.979026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fc24cf-5de9-4f1e-b06a-31a99171bcde tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:41.463126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-43fc24cf-5de9-4f1e-b06a-31a99171bcde tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504019 Oct 02 01:04:41.463766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 439/885] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:04:40 2022] POST /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:48.997383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c64b3d0-2b38-4bae-b401-0d1ad26f7760"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:48.999717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:49.006051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.006572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.007002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.007689 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.008142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.009093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.139118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Invalid volume: volume 7c64b3d0-2b38-4bae-b401-0d1ad26f7760 is already attached to instances: 2f829b4d-e5ad-48c1-82e8-c36676302a92 Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments HTTP/1.1 Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 74 Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:04:49.140838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {"volumeAttachment": {"volumeId": "7c64b3d0-2b38-4bae-b401-0d1ad26f7760"}} Oct 02 01:04:49.142587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Invalid volume: volume 7c64b3d0-2b38-4bae-b401-0d1ad26f7760 is already attached to instances: 2f829b4d-e5ad-48c1-82e8-c36676302a92 Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'server_id': '2f829b4d-e5ad-48c1-82e8-c36676302a92', 'body': {'volumeAttachment': {'volumeId': '7c64b3d0-2b38-4bae-b401-0d1ad26f7760'}}} Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7c64b3d0-2b38-4bae-b401-0d1ad26f7760 is already attached to instances: 2f829b4d-e5ad-48c1-82e8-c36676302a92 Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:49.143575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7c64b3d0-2b38-4bae-b401-0d1ad26f7760 is already attached to instances: 2f829b4d-e5ad-48c1-82e8-c36676302a92 Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:49.145135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:49.146746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:49.146746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:49.146746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:49.146746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7c64b3d0-2b38-4bae-b401-0d1ad26f7760 is already attached to instances: 2f829b4d-e5ad-48c1-82e8-c36676302a92 Oct 02 01:04:49.146746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:49.146746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 400 to user: Invalid volume: volume 7c64b3d0-2b38-4bae-b401-0d1ad26f7760 is already attached to instances: 2f829b4d-e5ad-48c1-82e8-c36676302a92 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:49.146746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82681dc1-3a88-4d18-8821-3140c38c81ed tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.148940 Oct 02 01:04:49.146746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 447/886] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:04:48 2022] POST /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments => generated 174 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:04:49.208435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:49.209023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:49.215951 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.216386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.216825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.217516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.217973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.218425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.296437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lazy-loading 'services' on Instance uuid 2f829b4d-e5ad-48c1-82e8-c36676302a92 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:49.364916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-de17ce0e-b0e0-4bbe-8be6-ce837c8f9a92 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments/7c64b3d0-2b38-4bae-b401-0d1ad26f7760" status: 202 len: 0 microversion: 2.1 time: 0.161268 Oct 02 01:04:49.365565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 440/887] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 01:04:49 2022] DELETE /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments/7c64b3d0-2b38-4bae-b401-0d1ad26f7760 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:04:49.374474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43af6bf1-1bf7-4b3c-a24b-8c86e5f9c6d3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:49.376619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43af6bf1-1bf7-4b3c-a24b-8c86e5f9c6d3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:49.384076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43af6bf1-1bf7-4b3c-a24b-8c86e5f9c6d3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.384560 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43af6bf1-1bf7-4b3c-a24b-8c86e5f9c6d3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.384990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43af6bf1-1bf7-4b3c-a24b-8c86e5f9c6d3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.385680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43af6bf1-1bf7-4b3c-a24b-8c86e5f9c6d3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:49.386154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43af6bf1-1bf7-4b3c-a24b-8c86e5f9c6d3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:49.386581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43af6bf1-1bf7-4b3c-a24b-8c86e5f9c6d3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:49.415073 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43af6bf1-1bf7-4b3c-a24b-8c86e5f9c6d3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Oct 02 01:04:49.415618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 448/888] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:04:49 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:50.428653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c2aeef1b-a5fb-4f43-b76d-468b7ec4ca79 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.431062 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c2aeef1b-a5fb-4f43-b76d-468b7ec4ca79 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:50.437144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2aeef1b-a5fb-4f43-b76d-468b7ec4ca79 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.437623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2aeef1b-a5fb-4f43-b76d-468b7ec4ca79 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.438050 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2aeef1b-a5fb-4f43-b76d-468b7ec4ca79 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.438755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2aeef1b-a5fb-4f43-b76d-468b7ec4ca79 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.439203 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2aeef1b-a5fb-4f43-b76d-468b7ec4ca79 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.439624 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2aeef1b-a5fb-4f43-b76d-468b7ec4ca79 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.468006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c2aeef1b-a5fb-4f43-b76d-468b7ec4ca79 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044121 Oct 02 01:04:50.468546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 441/889] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:04:50 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:04:50.537806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.538351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:50.544856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.545330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.545757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.546468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.546920 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.547338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.572340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:04:50.646571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00564b68-8368-4baf-9f8e-d0ebc1358e36 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 204 len: 0 microversion: 2.1 time: 0.112250 Oct 02 01:04:50.647148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 449/890] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:04:50 2022] DELETE /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:04:50.655971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:50.656570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:50.662722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.663206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.663638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.664343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:50.664776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:50.665193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:50.795256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:50.802866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-576aca69-f649-4c0f-947b-2f4b4987a429 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1681 microversion: 2.1 time: 0.150775 Oct 02 01:04:50.803421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 442/891] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:50 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:51.827337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:51.828291 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:51.834641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:51.835118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:51.835549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:51.836233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:51.836709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:51.837130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:51.962278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:51.969843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5fc59642-67c1-4085-8f87-fdc01726e295 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1681 microversion: 2.1 time: 0.146716 Oct 02 01:04:51.970436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 450/892] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:51 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:52.993379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:52.994102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:53.000915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:53.001399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:53.001875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:53.002886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:53.003471 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:53.003910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:53.225584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:53.234339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0c33c3a8-8cf6-423f-8159-8f0f46b9af06 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1681 microversion: 2.1 time: 0.245402 Oct 02 01:04:53.234919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 443/893] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:52 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:53.820467 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c372bc53-2007-429a-8049-f1c214b1da2b req-31428862-193c-4c00-afd1-5a3f60c62e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f829b4d-e5ad-48c1-82e8-c36676302a92", "name": "network-vif-deleted", "tag": "eb9ad07a-6799-41b1-91f6-ce5378b2cf93"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:53.831046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c372bc53-2007-429a-8049-f1c214b1da2b req-31428862-193c-4c00-afd1-5a3f60c62e15 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:53.831530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c372bc53-2007-429a-8049-f1c214b1da2b req-31428862-193c-4c00-afd1-5a3f60c62e15 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:53.831968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c372bc53-2007-429a-8049-f1c214b1da2b req-31428862-193c-4c00-afd1-5a3f60c62e15 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:53.843989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c372bc53-2007-429a-8049-f1c214b1da2b req-31428862-193c-4c00-afd1-5a3f60c62e15 service nova] Creating event network-vif-deleted:eb9ad07a-6799-41b1-91f6-ce5378b2cf93 for instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 on hv-cinder-maste Oct 02 01:04:53.848907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c372bc53-2007-429a-8049-f1c214b1da2b req-31428862-193c-4c00-afd1-5a3f60c62e15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032614 Oct 02 01:04:53.849612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 451/894] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:54.256746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:54.257368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:54.264198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:54.264700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:54.265132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:54.265826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:54.266303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:54.266728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:54.297424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:54.297901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:54.298364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:54.298810 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lazy-loading 'fault' on Instance uuid 2f829b4d-e5ad-48c1-82e8-c36676302a92 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:04:54.342201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:54.350181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-77177b83-40d1-420d-aa1f-440f12b4516c tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 200 len: 1330 microversion: 2.1 time: 0.097261 Oct 02 01:04:54.350924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 444/895] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:54 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:55.374006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:55.374675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:55.380931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:55.381417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:55.381856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:55.382570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:55.383034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:55.383468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:55.398356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 HTTP/1.1 Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:04:55.400748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:04:55.402512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '2f829b4d-e5ad-48c1-82e8-c36676302a92'} Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:04:55.403380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:04:55.404888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:04:55.406306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:04:55.406306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31fd4074-ce60-455e-9323-d400ee8dd4d0 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 404 len: 111 microversion: 2.1 time: 0.033195 Oct 02 01:04:55.406306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 452/896] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:55 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:04:55.411142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8177797e-c01b-40bf-af14-3f988f539bbd tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '.version_select at 0x7f6e78d6a430>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:55.430217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8177797e-c01b-40bf-af14-3f988f539bbd tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-984897730" status: 202 len: 0 microversion: 2.1 time: 0.022713 Oct 02 01:04:55.430774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 445/897] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Oct 2 01:04:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-984897730 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:04:56.021000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e696790-09cf-4fa1-8a07-ced225df0382 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: .version_select at 0x7f6e7c7edc10>, body: {"keypair": {"name": "tempest-keypair-503433159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI3AL/thP36wd4i8vk4hXk/W6zW+gEonE4uJw3p3hC7vW/DKd7wwMogLfQ78/4Oom+rLTp7GweNySyv2+jJjbK9wJplj7yw4m/6Zsq2Z1War1YRCqnGQmd7to6BVURmtg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:56.036758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-9e696790-09cf-4fa1-8a07-ced225df0382 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for project 29870f31b41846cc923a28ebfaf368db. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:56.040521 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-9e696790-09cf-4fa1-8a07-ced225df0382 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for user 1750f2cc69c0499ebade616da183507b and project 29870f31b41846cc923a28ebfaf368db. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:56.061316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e696790-09cf-4fa1-8a07-ced225df0382 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044173 Oct 02 01:04:56.061911 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 453/898] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 01:04:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:04:57.288984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1593266072", "imageRef": "42609e4e-26d1-400b-b4c2-32e95f8f88c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "187441bc-85a8-46c2-a472-a2fcaf6bcd79"}], "security_groups": [{"name": "tempest-securitygroup--1058900166"}], "key_name": "tempest-keypair-503433159", "user_data": "}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:04:57.393288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.network.neutron [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] validate_networks() for [('187441bc-85a8-46c2-a472-a2fcaf6bcd79', None, None, None, None, None)] {{(pid=120424) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:04:57.758386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Flavor limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:04:57.758809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Image limits 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:04:57.759308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Flavor pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:04:57.759712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Image pref 0:0:0 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:04:57.760117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.virt.hardware [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:04:57.768707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:57.769179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:57.769608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:57.770361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:57.770810 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:57.771229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:57.790186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for project 29870f31b41846cc923a28ebfaf368db. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:04:57.795192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Getting quotas for user 1750f2cc69c0499ebade616da183507b and project 29870f31b41846cc923a28ebfaf368db. Resources: {'ram', 'instances', 'cores'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:04:57.805867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Going to run 1 instances... {{(pid=120424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:04:57.808154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42609e4e-26d1-400b-b4c2-32e95f8f88c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:04:57.855921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1b65683f-2379-43a2-86ca-10b8ce6b3194 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.571720 Oct 02 01:04:57.856673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 446/899] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:04:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:04:57.868051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b4f1e116-b812-4ed5-b4bf-5965a2809756 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:57.869563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b4f1e116-b812-4ed5-b4bf-5965a2809756 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:57.923373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b4f1e116-b812-4ed5-b4bf-5965a2809756 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:57.932655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b4f1e116-b812-4ed5-b4bf-5965a2809756 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1241 microversion: 2.1 time: 0.068293 Oct 02 01:04:57.933217 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 454/900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:57 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:04:58.956350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:04:58.956938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:04:58.963010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:58.963499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:58.963936 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:58.964631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:04:58.965103 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:04:58.965554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:04:59.028416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:04:59.036583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0111f27d-c9f7-4a10-9c56-a0b176548ac2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1293 microversion: 2.1 time: 0.084626 Oct 02 01:04:59.037124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 447/901] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:04:58 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:00.059505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:00.060121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:00.066607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.067099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.067539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.068337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.068798 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.069232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.256460 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:00.265484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e13eb2af-d12a-4357-aa98-8dce436d095d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1367 microversion: 2.1 time: 0.209760 Oct 02 01:05:00.266100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 455/902] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:00 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:00.592444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-66ef8299-cfb6-431a-9cb0-9fd6064c54bf req-35b977f9-19d1-4a06-8f7b-a6adcb011b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2432a5db-0dc9-4645-abe6-b11cfd30add7", "tag": "0b3cdcda-d767-4429-8afc-c3755812d8a5"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:00.605316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-66ef8299-cfb6-431a-9cb0-9fd6064c54bf req-35b977f9-19d1-4a06-8f7b-a6adcb011b0c service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:00.606108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-66ef8299-cfb6-431a-9cb0-9fd6064c54bf req-35b977f9-19d1-4a06-8f7b-a6adcb011b0c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:00.606758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-66ef8299-cfb6-431a-9cb0-9fd6064c54bf req-35b977f9-19d1-4a06-8f7b-a6adcb011b0c service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:00.624243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-66ef8299-cfb6-431a-9cb0-9fd6064c54bf req-35b977f9-19d1-4a06-8f7b-a6adcb011b0c service nova] Creating event network-changed:0b3cdcda-d767-4429-8afc-c3755812d8a5 for instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 on hv-cinder-maste Oct 02 01:05:00.630456 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-66ef8299-cfb6-431a-9cb0-9fd6064c54bf req-35b977f9-19d1-4a06-8f7b-a6adcb011b0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041633 Oct 02 01:05:00.631056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 448/903] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:01.289747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:01.290356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:01.296837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:01.297315 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:01.297754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:01.298473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:01.298934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:01.299356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:01.490566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:01.499630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c08ee50c-1360-408b-a2fa-c75bcfaaaeb4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1367 microversion: 2.1 time: 0.214379 Oct 02 01:05:01.500196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 456/904] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:01 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:02.522678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:02.523487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:02.530130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:02.530608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:02.531046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:02.531737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:02.532182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:02.532605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:02.738169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:02.746409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-63097d9f-8472-4e56-b630-50d8f2855d3e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1367 microversion: 2.1 time: 0.227854 Oct 02 01:05:02.746968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 449/905] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:02 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:03.768686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:03.769306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:03.775791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.776280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.776718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.777413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:03.777872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:03.778325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:03.909711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:03.917482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d954992-9c7e-444b-b69d-8b2a23c70c3d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1367 microversion: 2.1 time: 0.152708 Oct 02 01:05:03.918075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 457/906] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:03 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:04.940539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:04.941152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:04.948422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.949105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.949812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:04.950627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:04.951081 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:04.951505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:05.078472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:05.086579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2816d2e5-3602-40b8-b884-836cdec6eec7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1367 microversion: 2.1 time: 0.149356 Oct 02 01:05:05.087144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 450/907] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:04 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:06.108933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:06.109567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:06.116382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.116867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.117867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.118597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:06.119049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:06.119501 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:06.249234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:06.258695 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6bbb0956-c8ff-40da-ac4e-608335cc1aee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1367 microversion: 2.1 time: 0.153772 Oct 02 01:05:06.259275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 458/908] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:06 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:07.280774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:07.281396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:07.287937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.288441 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.288877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.290082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.290536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.290986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.417463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:07.425123 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e130b0c2-a5ff-4b93-998f-b0c8983e22ad tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1367 microversion: 2.1 time: 0.148241 Oct 02 01:05:07.425693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 451/909] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:07 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:07.638878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-61969021-d5af-412d-a657-487ebbf31309 req-d8f86bfe-a2af-4ea6-b99f-71b03b8bb130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2432a5db-0dc9-4645-abe6-b11cfd30add7", "name": "network-vif-plugged", "status": "completed", "tag": "0b3cdcda-d767-4429-8afc-c3755812d8a5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:07.649250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-61969021-d5af-412d-a657-487ebbf31309 req-d8f86bfe-a2af-4ea6-b99f-71b03b8bb130 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:07.649741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-61969021-d5af-412d-a657-487ebbf31309 req-d8f86bfe-a2af-4ea6-b99f-71b03b8bb130 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:07.650201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-61969021-d5af-412d-a657-487ebbf31309 req-d8f86bfe-a2af-4ea6-b99f-71b03b8bb130 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:07.661318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-61969021-d5af-412d-a657-487ebbf31309 req-d8f86bfe-a2af-4ea6-b99f-71b03b8bb130 service nova] Creating event network-vif-plugged:0b3cdcda-d767-4429-8afc-c3755812d8a5 for instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 on hv-cinder-maste Oct 02 01:05:07.667015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-61969021-d5af-412d-a657-487ebbf31309 req-d8f86bfe-a2af-4ea6-b99f-71b03b8bb130 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032182 Oct 02 01:05:07.667812 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 459/910] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:08.448540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:08.449063 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:08.451033 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:08.451677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:08.458199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:08.458690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:08.459098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:08.459780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:08.460225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:08.460643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:08.587798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:08.595444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f769db08-3455-42ee-b13f-3f05403e4a4a tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1367 microversion: 2.1 time: 0.151597 Oct 02 01:05:08.596007 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 452/911] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:08 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:09.615507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:09.620629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:09.621332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:09.623122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:09.629491 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.629980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.630443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.631142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.631600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.632028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.637311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:09.762649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:09.770203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a35136ee-0ffe-472a-85e1-75dc7375863f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1557 microversion: 2.1 time: 0.155716 Oct 02 01:05:09.770774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 460/912] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:09 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:09.792068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-47d31195-2e9d-4e86-b682-870beaae75a5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:09.792594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-47d31195-2e9d-4e86-b682-870beaae75a5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:09.799019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47d31195-2e9d-4e86-b682-870beaae75a5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.799505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47d31195-2e9d-4e86-b682-870beaae75a5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.799944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47d31195-2e9d-4e86-b682-870beaae75a5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.800635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47d31195-2e9d-4e86-b682-870beaae75a5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:09.801090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47d31195-2e9d-4e86-b682-870beaae75a5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:09.801516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47d31195-2e9d-4e86-b682-870beaae75a5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:09.876685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-47d31195-2e9d-4e86-b682-870beaae75a5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088396 Oct 02 01:05:09.877277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 453/913] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Oct 2 01:05:09 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:10.773949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a17d4adf-eb14-46c6-ab9e-8b92775d5fbe req-6112b3bd-82e8-44fd-9bfb-0f474d800601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2432a5db-0dc9-4645-abe6-b11cfd30add7", "tag": "0b3cdcda-d767-4429-8afc-c3755812d8a5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:10.784253 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a17d4adf-eb14-46c6-ab9e-8b92775d5fbe req-6112b3bd-82e8-44fd-9bfb-0f474d800601 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:10.784727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a17d4adf-eb14-46c6-ab9e-8b92775d5fbe req-6112b3bd-82e8-44fd-9bfb-0f474d800601 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:10.785157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a17d4adf-eb14-46c6-ab9e-8b92775d5fbe req-6112b3bd-82e8-44fd-9bfb-0f474d800601 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:10.798426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a17d4adf-eb14-46c6-ab9e-8b92775d5fbe req-6112b3bd-82e8-44fd-9bfb-0f474d800601 service nova] Creating event network-changed:0b3cdcda-d767-4429-8afc-c3755812d8a5 for instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 on hv-cinder-maste Oct 02 01:05:10.803380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a17d4adf-eb14-46c6-ab9e-8b92775d5fbe req-6112b3bd-82e8-44fd-9bfb-0f474d800601 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033066 Oct 02 01:05:10.804067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 461/914] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:35.364657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:35.365424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:35.369556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:35.370071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:35.378656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.379136 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.379570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.380260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.380709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.381133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.407532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:05:35.478896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e2313c68-b235-451f-8fee-954417deef5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 204 len: 0 microversion: 2.1 time: 0.115539 Oct 02 01:05:35.479477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 454/915] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:35 2022] DELETE /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:05:35.487462 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:35.488305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=7 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:35.492354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:35.493045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:35.500785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.501265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.501704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.502420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:35.502878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:35.503302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:35.631897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:35.639584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-482d0cbe-b7dc-448b-87a6-9b7f5e6c0fa7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1577 microversion: 2.1 time: 0.154247 Oct 02 01:05:35.640139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 462/916] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:35 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:36.662855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:36.663560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:36.669895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:36.670408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:36.670842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:36.671532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:36.671985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:36.672411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:36.802736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:36.811078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7f4764e6-c98b-4f8b-8a03-d563dabc8fe6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1577 microversion: 2.1 time: 0.152392 Oct 02 01:05:36.811651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 455/917] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:36 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:37.835588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:37.836209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:37.843142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.843630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.844071 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:37.844803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:37.845266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:37.845692 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:38.315106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:38.323007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5148eec-f739-4f0f-9a7d-5ff685edd956 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1577 microversion: 2.1 time: 0.491367 Oct 02 01:05:38.323654 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 463/918] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:37 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1577 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:38.608064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-da7436d2-a163-49bc-868f-7c850bfea71a req-27d48b33-7c3c-4855-abb4-9dcfa109ebed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c321dc-02fa-4499-b40f-35a4d2409bae", "name": "network-vif-deleted", "tag": "807ec6f3-5032-4e60-8c4d-a4607a99b2ab"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:38.618501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-da7436d2-a163-49bc-868f-7c850bfea71a req-27d48b33-7c3c-4855-abb4-9dcfa109ebed service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:38.619171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-da7436d2-a163-49bc-868f-7c850bfea71a req-27d48b33-7c3c-4855-abb4-9dcfa109ebed service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:38.619454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-da7436d2-a163-49bc-868f-7c850bfea71a req-27d48b33-7c3c-4855-abb4-9dcfa109ebed service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:38.637503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-da7436d2-a163-49bc-868f-7c850bfea71a req-27d48b33-7c3c-4855-abb4-9dcfa109ebed service nova] Creating event network-vif-deleted:807ec6f3-5032-4e60-8c4d-a4607a99b2ab for instance 46c321dc-02fa-4499-b40f-35a4d2409bae on hv-cinder-maste Oct 02 01:05:38.642735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-da7436d2-a163-49bc-868f-7c850bfea71a req-27d48b33-7c3c-4855-abb4-9dcfa109ebed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109700 Oct 02 01:05:38.647453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 456/919] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:39.347203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:39.347967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:39.355165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:39.355706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:39.356210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:39.357019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:39.357477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:39.358017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:39.392480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:39.392969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:39.393413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:39.393872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lazy-loading 'fault' on Instance uuid 46c321dc-02fa-4499-b40f-35a4d2409bae {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:39.435966 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:39.444867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81ed92d5-f6da-4663-ba40-00e03d131cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 200 len: 1230 microversion: 2.1 time: 0.101381 Oct 02 01:05:39.445502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 464/920] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:39 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:40.470310 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:40.471059 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:40.477607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:40.478109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:40.478543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:40.479230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:40.479677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:40.480795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:40.494124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] HTTP exception thrown: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Request method failure captured: Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae HTTP/1.1 Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOM5wDBJWcvhfFabEBI23QcSvQcYL_1Zm5LPORD83k4M4YoavqBp8wQgEaD-ms4c3WQNBjjcRC7ArFwVHXD3ftgQFzyDEf-KYyhyXUkkk34114Gf2zmX2BKpPZli0YVJNaw4SojV4b1BWjyyRsJwiPuQTyYxw0oleUmwFwm6dphUzFs Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 017c596a2d0f430d987352a616666610 Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-TestVolumeBootPattern-747325683 Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:05:40.495739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/017c596a2d0f430d987352a616666610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/017c596a2d0f430d987352a616666610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_017c596a2d0f430d987352a616666610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/017c596a2d0f430d987352a616666610"}]}] Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-TestVolumeBootPattern-747325683 Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 017c596a2d0f430d987352a616666610 Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-TestVolumeBootPattern-747325683 Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-TestVolumeBootPattern-747325683-project Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: a94a5f91289c403cb49f428e53431591 Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-TestVolumeBootPattern-747325683-project Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:05:40.497427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '46c321dc-02fa-4499-b40f-35a4d2409bae'} Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:05:40.498395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:05:40.499772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:05:40.501041 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Returning 404 to user: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:05:40.501041 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-69f4ad6c-47eb-4fd3-ae18-e45c546a3058 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 404 len: 111 microversion: 2.1 time: 0.031045 Oct 02 01:05:40.501041 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 457/921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:40 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:05:40.590817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1331260755", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1356466823", "security_groups": [{"name": "tempest-secgroup-smoke-306983037"}], "block_device_mapping_v2": [{"uuid": "16f53961-8a96-4ab4-8165-499c10be8d32", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7abe6454-7fe6-4ac7-b3ad-227b22f373e8"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:40.700954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] validate_networks() for [('7abe6454-7fe6-4ac7-b3ad-227b22f373e8', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:05:41.080931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:05:41.081367 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:05:41.081852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:05:41.082308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:05:41.082729 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:05:41.091487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:41.091975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:41.092417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:41.093154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:41.093615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:41.094046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:41.110496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Getting quotas for project 017c596a2d0f430d987352a616666610. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:05:41.114658 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Getting quotas for user a94a5f91289c403cb49f428e53431591 and project 017c596a2d0f430d987352a616666610. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:05:41.169802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:05:41.171959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16f53961-8a96-4ab4-8165-499c10be8d32',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:05:41.298940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dda3e6ec-b03d-4806-949a-7f1c40fdc6bb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.712467 Oct 02 01:05:41.299577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 465/922] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:05:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:05:41.311156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-84c3bb39-e4cb-4b2c-bcc0-6f804e086033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:41.311763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-84c3bb39-e4cb-4b2c-bcc0-6f804e086033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:41.366150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-84c3bb39-e4cb-4b2c-bcc0-6f804e086033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:41.373424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-84c3bb39-e4cb-4b2c-bcc0-6f804e086033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1095 microversion: 2.1 time: 0.066617 Oct 02 01:05:41.373984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 458/923] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:41 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:42.396898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:42.397511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:42.403858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:42.404342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:42.404777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:42.405473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:42.405933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:42.406387 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:42.472596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:42.480996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26b8a482-1c6e-48d5-969e-8daf145fded1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1193 microversion: 2.1 time: 0.088507 Oct 02 01:05:42.481559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 466/924] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:42 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:43.506465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:43.507135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:43.515538 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:43.516342 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:43.517009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:43.517827 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:43.518524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:43.519519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:43.721871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:43.730471 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a3438359-75ab-4875-b4a1-af435a8666e9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.227499 Oct 02 01:05:43.731046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 459/925] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:43 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:44.038628 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f8265627-2f22-4afb-83ae-8aa0171201c4 req-3f9a7f18-c5cd-452f-a2a1-bfa069469139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20234809-0f73-4a21-a8ab-08a7715c83fd", "tag": "49b1bf72-665b-4d49-b376-5134dc334f5c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:44.050111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f8265627-2f22-4afb-83ae-8aa0171201c4 req-3f9a7f18-c5cd-452f-a2a1-bfa069469139 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:44.050859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f8265627-2f22-4afb-83ae-8aa0171201c4 req-3f9a7f18-c5cd-452f-a2a1-bfa069469139 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:44.051297 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f8265627-2f22-4afb-83ae-8aa0171201c4 req-3f9a7f18-c5cd-452f-a2a1-bfa069469139 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:44.062211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f8265627-2f22-4afb-83ae-8aa0171201c4 req-3f9a7f18-c5cd-452f-a2a1-bfa069469139 service nova] Creating event network-changed:49b1bf72-665b-4d49-b376-5134dc334f5c for instance 20234809-0f73-4a21-a8ab-08a7715c83fd on hv-cinder-maste Oct 02 01:05:44.067040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f8265627-2f22-4afb-83ae-8aa0171201c4 req-3f9a7f18-c5cd-452f-a2a1-bfa069469139 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032307 Oct 02 01:05:44.067644 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 467/926] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:44.754825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:44.755452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:44.762668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:44.763157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:44.763598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:44.764302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:44.764760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:44.765184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:44.972416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:44.980591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ba315606-60d9-49aa-b6a1-c59c6b57028e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.229595 Oct 02 01:05:44.981161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 460/927] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:44 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:46.005663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:46.006392 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:46.013344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.013835 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.014290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:46.014997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.015448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.015870 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:46.153255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:46.164644 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-478a58d3-189e-442b-8c1d-0ab41e1ab2b9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.163825 Oct 02 01:05:46.165190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 468/928] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:45 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:46.738121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-18fe7766-bc6b-4db8-aca5-4c434771db2e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:46.738679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-18fe7766-bc6b-4db8-aca5-4c434771db2e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:46.745027 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18fe7766-bc6b-4db8-aca5-4c434771db2e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.745506 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18fe7766-bc6b-4db8-aca5-4c434771db2e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.745940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18fe7766-bc6b-4db8-aca5-4c434771db2e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:46.746654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18fe7766-bc6b-4db8-aca5-4c434771db2e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:46.747104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18fe7766-bc6b-4db8-aca5-4c434771db2e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:46.747526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18fe7766-bc6b-4db8-aca5-4c434771db2e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:46.770535 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-18fe7766-bc6b-4db8-aca5-4c434771db2e tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/ips" status: 200 len: 150 microversion: 2.1 time: 0.036668 Oct 02 01:05:46.771079 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 461/929] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Oct 2 01:05:46 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:47.187522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:47.188129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:47.194443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:47.194924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:47.195353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:47.196031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:47.196476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:47.196946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:47.326913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:47.334430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6e22607-5660-4f1f-a070-b9fc4ff082ec tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.151240 Oct 02 01:05:47.334981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 469/930] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:47 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:48.102181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fd3a3345-dd55-4e24-a98b-daae86aad6f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71f01e17-8464-47b1-9110-6888ccd05d99"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:48.104544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fd3a3345-dd55-4e24-a98b-daae86aad6f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:48.111619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd3a3345-dd55-4e24-a98b-daae86aad6f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:48.112357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd3a3345-dd55-4e24-a98b-daae86aad6f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:48.112796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd3a3345-dd55-4e24-a98b-daae86aad6f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:48.113484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd3a3345-dd55-4e24-a98b-daae86aad6f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:48.113942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd3a3345-dd55-4e24-a98b-daae86aad6f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:48.114401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fd3a3345-dd55-4e24-a98b-daae86aad6f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:48.357249 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:48.357936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:48.364739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:48.365300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:48.365872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:48.366843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:48.367364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:48.368102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:48.387086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fd3a3345-dd55-4e24-a98b-daae86aad6f5 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "POST /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288619 Oct 02 01:05:48.388206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 462/931] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:05:48 2022] POST /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:48.510556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:48.518351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4975d179-8015-4ecc-9b7f-b6783858fd73 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.165414 Oct 02 01:05:48.518909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 470/932] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:48 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:49.541732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:49.543055 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:49.549627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:49.550139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:49.550581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:49.551265 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:49.551713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:49.552132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:49.677504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:49.685601 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f407f4b9-94fb-49ca-abd0-b9fac0956033 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.148078 Oct 02 01:05:49.686178 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 463/933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:49 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:50.708008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:50.708623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:50.715108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:50.715589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:50.716024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:50.716721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:50.717175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:50.717596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:50.847113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:50.854739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89fe48a7-b155-416f-8439-7db4594ee31c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.150600 Oct 02 01:05:50.855940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 471/934] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:50 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:51.878254 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:51.878871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:51.881257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:51.887266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:51.887749 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:51.888184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:51.888874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:51.889332 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:51.889756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:52.019512 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:52.027298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bd9c7df2-36ce-491c-9e93-ba2376cbeefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.152910 Oct 02 01:05:52.027871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 464/935] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:51 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:53.049728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:53.050382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:53.052422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:53.053250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:53.060980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:53.061478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:53.061924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:53.062666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:53.063137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:53.063572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:53.194202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:53.202428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa450cc0-f1a7-4897-9dce-3f04d1614aa4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.156600 Oct 02 01:05:53.202989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 472/936] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:53 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:54.224742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:54.225358 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:54.231724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.232211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.232644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.233336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:54.233790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:54.234255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:54.362473 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:54.370140 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4e0fd415-37ac-4400-a6b7-e14d931f8df1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.149259 Oct 02 01:05:54.370701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 465/937] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:54 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:55.392882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:55.393432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:55.399927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:55.400420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:55.400861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.401555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:55.402016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:55.402474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.532659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:55.540340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc54fc6e-e204-4f07-9b08-e7d3cefafff5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.151443 Oct 02 01:05:55.540897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 473/938] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:55 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:55.925536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-7e9b11b2-2bc0-46e1-919d-18dcf75d2ec2 req-bb21cfd3-78bd-4890-81ea-e841a4368adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20234809-0f73-4a21-a8ab-08a7715c83fd", "name": "network-vif-plugged", "status": "completed", "tag": "49b1bf72-665b-4d49-b376-5134dc334f5c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:55.935792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7e9b11b2-2bc0-46e1-919d-18dcf75d2ec2 req-bb21cfd3-78bd-4890-81ea-e841a4368adc service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:55.936497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7e9b11b2-2bc0-46e1-919d-18dcf75d2ec2 req-bb21cfd3-78bd-4890-81ea-e841a4368adc service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:55.936960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-7e9b11b2-2bc0-46e1-919d-18dcf75d2ec2 req-bb21cfd3-78bd-4890-81ea-e841a4368adc service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:55.948087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-7e9b11b2-2bc0-46e1-919d-18dcf75d2ec2 req-bb21cfd3-78bd-4890-81ea-e841a4368adc service nova] Creating event network-vif-plugged:49b1bf72-665b-4d49-b376-5134dc334f5c for instance 20234809-0f73-4a21-a8ab-08a7715c83fd on hv-cinder-maste Oct 02 01:05:55.953615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-7e9b11b2-2bc0-46e1-919d-18dcf75d2ec2 req-bb21cfd3-78bd-4890-81ea-e841a4368adc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095414 Oct 02 01:05:55.954226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 466/939] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:05:56.037366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:56.037824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:56.043957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.044478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.044961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.045727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.046256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.046734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.131975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lazy-loading 'services' on Instance uuid 2432a5db-0dc9-4645-abe6-b11cfd30add7 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:05:56.204047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2433f1a-d8ed-4bbd-9c22-d3959be787a9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments/71f01e17-8464-47b1-9110-6888ccd05d99" status: 202 len: 0 microversion: 2.1 time: 0.170763 Oct 02 01:05:56.204640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 474/940] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 01:05:56 2022] DELETE /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments/71f01e17-8464-47b1-9110-6888ccd05d99 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:05:56.213359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f50daffe-e253-4aae-b301-303fb2c372a3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:56.215689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f50daffe-e253-4aae-b301-303fb2c372a3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:56.222626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f50daffe-e253-4aae-b301-303fb2c372a3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.223042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f50daffe-e253-4aae-b301-303fb2c372a3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.223711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f50daffe-e253-4aae-b301-303fb2c372a3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.224543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f50daffe-e253-4aae-b301-303fb2c372a3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.225004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f50daffe-e253-4aae-b301-303fb2c372a3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.225658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f50daffe-e253-4aae-b301-303fb2c372a3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.257686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f50daffe-e253-4aae-b301-303fb2c372a3 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048481 Oct 02 01:05:56.258746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 467/941] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:56 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:56.564449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:56.565135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:56.571279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.571760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.572191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.572886 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:56.573331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:56.573753 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:56.701818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:56.709408 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82599afd-3903-499a-a333-ab6e2be91516 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1266 microversion: 2.1 time: 0.149622 Oct 02 01:05:56.709957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 475/942] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:56 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:57.270435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fe61ccdc-0875-4bd7-889e-5da93c691a43 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:57.272558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fe61ccdc-0875-4bd7-889e-5da93c691a43 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:57.279084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe61ccdc-0875-4bd7-889e-5da93c691a43 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.279567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe61ccdc-0875-4bd7-889e-5da93c691a43 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.280001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe61ccdc-0875-4bd7-889e-5da93c691a43 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.280688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe61ccdc-0875-4bd7-889e-5da93c691a43 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.281176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe61ccdc-0875-4bd7-889e-5da93c691a43 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.281562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe61ccdc-0875-4bd7-889e-5da93c691a43 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.313814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fe61ccdc-0875-4bd7-889e-5da93c691a43 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047378 Oct 02 01:05:57.314421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 468/943] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:57 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:05:57.733010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:57.733625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:57.740556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.741045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.741485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.742224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.742681 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.743110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.875492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:57.883250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ea9b092-9787-4972-ae5c-ed54eff77210 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1453 microversion: 2.1 time: 0.154324 Oct 02 01:05:57.883831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 476/944] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:57 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:57.906095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:57.906716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:57.912706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.913128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.913564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:57.914279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:57.914735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:57.915163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.043470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:58.051750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0e642c8c-860b-4868-b6a2-0b95f0a1b99e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1453 microversion: 2.1 time: 0.149560 Oct 02 01:05:58.052314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 469/945] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:57 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:05:58.325856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f68b6264-abb5-4194-8b79-8d53db31e346 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:58.328551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f68b6264-abb5-4194-8b79-8d53db31e346 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:58.334477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f68b6264-abb5-4194-8b79-8d53db31e346 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.334963 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f68b6264-abb5-4194-8b79-8d53db31e346 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.335396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f68b6264-abb5-4194-8b79-8d53db31e346 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.336222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f68b6264-abb5-4194-8b79-8d53db31e346 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.336953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f68b6264-abb5-4194-8b79-8d53db31e346 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.337387 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f68b6264-abb5-4194-8b79-8d53db31e346 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.368321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f68b6264-abb5-4194-8b79-8d53db31e346 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046468 Oct 02 01:05:58.368879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 477/946] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:05:58 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 02 01:05:58.434224 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:58.434752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:58.441126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.441622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.442080 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.442875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.443333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.443759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.469658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:05:58.472735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:58.549419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-66a8e736-e648-4710-b739-ce8c295c330d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 204 len: 0 microversion: 2.1 time: 0.118610 Oct 02 01:05:58.553638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 470/947] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:05:58 2022] DELETE /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:05:58.562838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:05:58.564817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:05:58.571181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.571758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.572265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:58.573039 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:58.573592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:58.574272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:59.064132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:05:59.067723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:05:59.072806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad3666f9-0d76-4ece-911e-befeb50756a4 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1682 microversion: 2.1 time: 0.517698 Oct 02 01:05:59.073400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 478/948] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:05:58 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1682 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:05:59.944523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-50098cf8-7451-4617-b697-000299259025 req-ee04467e-1ce1-4645-a38f-e5022bce249f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20234809-0f73-4a21-a8ab-08a7715c83fd", "tag": "49b1bf72-665b-4d49-b376-5134dc334f5c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:05:59.954628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-50098cf8-7451-4617-b697-000299259025 req-ee04467e-1ce1-4645-a38f-e5022bce249f service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:05:59.955100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-50098cf8-7451-4617-b697-000299259025 req-ee04467e-1ce1-4645-a38f-e5022bce249f service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:05:59.956095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-50098cf8-7451-4617-b697-000299259025 req-ee04467e-1ce1-4645-a38f-e5022bce249f service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:05:59.967850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-50098cf8-7451-4617-b697-000299259025 req-ee04467e-1ce1-4645-a38f-e5022bce249f service nova] Creating event network-changed:49b1bf72-665b-4d49-b376-5134dc334f5c for instance 20234809-0f73-4a21-a8ab-08a7715c83fd on hv-cinder-maste Oct 02 01:05:59.973092 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-50098cf8-7451-4617-b697-000299259025 req-ee04467e-1ce1-4645-a38f-e5022bce249f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032452 Oct 02 01:05:59.974043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 471/949] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:00.097674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:00.098401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:00.105272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.105846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.106386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.107153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:00.107609 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:00.108031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:00.308621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:00.316908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e36512a5-411e-4c94-a53c-9669ae4cf96f tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1682 microversion: 2.1 time: 0.224518 Oct 02 01:06:00.317686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 479/950] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:00 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:01.341869 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:01.342545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:01.348700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:01.349184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:01.349629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:01.350353 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:01.350812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:01.351275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:01.441933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1750f2cc69c0499ebade616da183507b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29870f31b41846cc923a28ebfaf368db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:06:01.450273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-db89e8cd-84bd-4c8a-af20-c15df55c5976 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 200 len: 1614 microversion: 2.1 time: 0.113644 Oct 02 01:06:01.450862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 472/951] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:01 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 1614 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:06:01.988717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f9ea04fd-ff72-4432-814f-62ccbda67a9c req-5e1cb7b4-8570-44d5-9ab5-8450b3391e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2432a5db-0dc9-4645-abe6-b11cfd30add7", "name": "network-vif-deleted", "tag": "0b3cdcda-d767-4429-8afc-c3755812d8a5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:06:02.004388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f9ea04fd-ff72-4432-814f-62ccbda67a9c req-5e1cb7b4-8570-44d5-9ab5-8450b3391e1e service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:02.004948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f9ea04fd-ff72-4432-814f-62ccbda67a9c req-5e1cb7b4-8570-44d5-9ab5-8450b3391e1e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:02.005443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f9ea04fd-ff72-4432-814f-62ccbda67a9c req-5e1cb7b4-8570-44d5-9ab5-8450b3391e1e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:02.018443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f9ea04fd-ff72-4432-814f-62ccbda67a9c req-5e1cb7b4-8570-44d5-9ab5-8450b3391e1e service nova] Creating event network-vif-deleted:0b3cdcda-d767-4429-8afc-c3755812d8a5 for instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 on hv-cinder-maste Oct 02 01:06:02.024506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f9ea04fd-ff72-4432-814f-62ccbda67a9c req-5e1cb7b4-8570-44d5-9ab5-8450b3391e1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039816 Oct 02 01:06:02.034844 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 480/952] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:06:02.474933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:02.475613 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:02.482691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:02.483266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:02.483706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:02.484417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:02.484873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:02.485306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:02.499991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 HTTP/1.1 Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:06:02.501658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:02.503405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '2432a5db-0dc9-4645-abe6-b11cfd30add7'} Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:02.504411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:02.505969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:02.507673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:02.507673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-28536fdd-b93a-47d9-8dcf-130b79c63ea7 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 404 len: 111 microversion: 2.1 time: 0.034214 Oct 02 01:06:02.507673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 473/953] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:02 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:02.512690 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d4d475a-2dec-45dd-9f58-e64e1ed5d745 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '.version_select at 0x7f6e78dec5e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:02.531042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d4d475a-2dec-45dd-9f58-e64e1ed5d745 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503433159" status: 202 len: 0 microversion: 2.1 time: 0.022586 Oct 02 01:06:02.531608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 481/954] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Oct 2 01:06:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503433159 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:06:04.276977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:04.277458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:04.284348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:04.284821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:04.285249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:04.285928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:04.286423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:04.286825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:04.300562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 HTTP/1.1 Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:06:04.302118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.303760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '2432a5db-0dc9-4645-abe6-b11cfd30add7'} Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:04.304667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.306183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.307634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:04.307634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e02584c3-c8a6-4b9a-a100-ab083e362885 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 404 len: 111 microversion: 2.1 time: 0.030716 Oct 02 01:06:04.307634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 474/955] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:06:04 2022] DELETE /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:04.312467 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:04.313245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2432a5db-0dc9-4645-abe6-b11cfd30add7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:04.319937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:04.320400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:04.320837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:04.321531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:04.321993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:04.322446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:04.335301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 HTTP/1.1 Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:06:04.336906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.338508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '2432a5db-0dc9-4645-abe6-b11cfd30add7'} Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:04.342148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. Oct 02 01:06:04.343646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:04.344981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance 2432a5db-0dc9-4645-abe6-b11cfd30add7 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:04.344981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3a7248e-bb44-491d-8330-678b3ce63624 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7" status: 404 len: 111 microversion: 2.1 time: 0.030249 Oct 02 01:06:04.344981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 482/956] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:04 2022] GET /compute/v2.1/servers/2432a5db-0dc9-4645-abe6-b11cfd30add7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 02 01:06:05.474707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:05.475199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:05.477579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:05.483444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.484011 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.484445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.485129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.485610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.486033 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.500882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 HTTP/1.1 Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:06:05.502426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.504143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '2f829b4d-e5ad-48c1-82e8-c36676302a92'} Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:05.505039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.506563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.508305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:05.508305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3dd96715-a584-4120-8baf-a4a2200788f2 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 404 len: 111 microversion: 2.1 time: 0.032873 Oct 02 01:06:05.508305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 475/957] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:06:05 2022] DELETE /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:05.511991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:05.512611 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 2f829b4d-e5ad-48c1-82e8-c36676302a92] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:05.515052 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:06:05.520267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.520740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.521167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.521848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.522322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.522751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.539214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 HTTP/1.1 Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:06:05.540723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.542351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '2f829b4d-e5ad-48c1-82e8-c36676302a92'} Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:05.543287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. Oct 02 01:06:05.545279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.546725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance 2f829b4d-e5ad-48c1-82e8-c36676302a92 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:05.546725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d776b051-a758-4c11-8338-8c5b1ffed5e9 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92" status: 404 len: 111 microversion: 2.1 time: 0.033857 Oct 02 01:06:05.546725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 483/958] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:05 2022] GET /compute/v2.1/servers/2f829b4d-e5ad-48c1-82e8-c36676302a92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:05.551120 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:05.551619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:05.557421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.557903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.558372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.559067 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.559519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.560593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.573675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 HTTP/1.1 Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:06:05.575239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.576861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': 'b21532c9-c67d-40e7-a8c2-56989e7f2498'} Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:05.577832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.579401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.580991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:05.580991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-450ccccf-f019-4d1e-b0c6-94b45e2f6eee tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 404 len: 111 microversion: 2.1 time: 0.029338 Oct 02 01:06:05.580991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 476/959] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:06:05 2022] DELETE /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:05.584754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:05.585400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: b21532c9-c67d-40e7-a8c2-56989e7f2498] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:05.591285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.591892 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.592323 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.593007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:05.593456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:05.594031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:05.607619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 HTTP/1.1 Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:06:05.609101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.610720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': 'b21532c9-c67d-40e7-a8c2-56989e7f2498'} Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:05.611531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. Oct 02 01:06:05.613112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:05.614245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance b21532c9-c67d-40e7-a8c2-56989e7f2498 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:05.614245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c41b2843-b4a7-47dd-9748-10bda63951bc tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498" status: 404 len: 111 microversion: 2.1 time: 0.029575 Oct 02 01:06:05.614245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 484/960] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:05 2022] GET /compute/v2.1/servers/b21532c9-c67d-40e7-a8c2-56989e7f2498 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:06.750002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:06.750544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:06.756932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:06.757411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:06.757850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:06.758565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:06.759023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:06.759450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:06.774405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 HTTP/1.1 Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:06:06.775955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.777561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1'} Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:06.779173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.780647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.782288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:06.782288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f3231cdf-296e-4cf1-99c0-60603985b053 tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "DELETE /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 404 len: 111 microversion: 2.1 time: 0.031221 Oct 02 01:06:06.782288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 477/961] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:06:06 2022] DELETE /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:06:06.786015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:06:06.786667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] [instance: 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:06:06.793014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:06.793579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:06.794684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:06.795384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:06:06.795837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:06:06.796266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:06:06.809397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] HTTP exception thrown: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Request method failure captured: Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 HTTP/1.1 Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOLidGIEi35D-uvECiENmVkkiFP0aAKs0yRURMSKYkOigzcwKiX6nwaT76j3qRmh3q4vZPk9KK0wxpbrsr_qzb1hmCfDW1TLj7S3RW2UYmIar_j4rAW5vPoXUBugk4Hjf1pzHdWAmeH-IwNg5do4t7EYhPGACKsJNkNXRPnrZOTGmmI Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:06:06.810989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29870f31b41846cc923a28ebfaf368db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29870f31b41846cc923a28ebfaf368db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29870f31b41846cc923a28ebfaf368db"}]}] Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 29870f31b41846cc923a28ebfaf368db Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-888860700 Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: 1750f2cc69c0499ebade616da183507b Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-888860700-project Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.812548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1'} Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:06:06.813482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. Oct 02 01:06:06.814818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:06:06.815996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] Returning 404 to user: Instance 880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:06:06.815996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40d3b704-dfd6-4bd6-8e24-354084f5c06d tempest-AttachVolumeNegativeTest-888860700 tempest-AttachVolumeNegativeTest-888860700-project] 10.222.0.25 "GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1" status: 404 len: 111 microversion: 2.1 time: 0.030130 Oct 02 01:06:06.815996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 485/962] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:06:06 2022] GET /compute/v2.1/servers/880e8d2b-ae16-442c-bbca-e1ea0b1b4ff1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:07:11.114851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=5 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:11.115595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:11.117060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 01:07:11.117231 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Oct 02 01:07:11.122647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-57986ef8-ef7a-478e-9840-7a94a479d4da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Action: 'create', calling method: .version_select at 0x7f6e78d6a820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-662543878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJC/OPeQQ+ESXPCvu6F05WqvG+I6geQqJ/KgtrbqsYvC8127LpvUUHXjPIiliLbuGf2iqiqo8S0zajEKkR6oe5ZpRTiylB+lBqeonBDRgz8TZ4d/JnzZFUdz1O/HhaBPQ=="}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:11.143089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-57986ef8-ef7a-478e-9840-7a94a479d4da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Getting quotas for project ff4a21c5f4b04110b2fa42a2bba32348. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:07:11.146885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.quota [None req-57986ef8-ef7a-478e-9840-7a94a479d4da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Getting quotas for user 47e0ae04969b4f7684cb21edaaa85b55 and project ff4a21c5f4b04110b2fa42a2bba32348. Resources: {'key_pairs'} {{(pid=120424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:07:11.167840 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-57986ef8-ef7a-478e-9840-7a94a479d4da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055083 Oct 02 01:07:11.168426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 478/963] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Oct 2 01:07:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:11.215318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=5 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:11.216055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=16 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:11.220466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-426839218", "imageRef": "a933ae54-fb0f-4076-8085-0499b00435b2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-662543878", "networks": [{"uuid": "7c32ae03-4625-46fe-89cf-d303ccf124b1"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:11.272713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] validate_networks() for [('7c32ae03-4625-46fe-89cf-d303ccf124b1', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 02 01:07:11.740134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 02 01:07:11.740559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 02 01:07:11.741034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 02 01:07:11.741438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 02 01:07:11.741846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 02 01:07:11.750770 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.751251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.751684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:11.752405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:11.752855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:11.753306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:11.769532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Getting quotas for project ff4a21c5f4b04110b2fa42a2bba32348. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 02 01:07:11.773405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.quota [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Getting quotas for user 47e0ae04969b4f7684cb21edaaa85b55 and project ff4a21c5f4b04110b2fa42a2bba32348. Resources: {'ram', 'instances', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 02 01:07:11.784622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 02 01:07:11.786826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a933ae54-fb0f-4076-8085-0499b00435b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 02 01:07:11.832971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1f5c0657-ebaa-4507-9821-164dc68bc0a6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619314 Oct 02 01:07:11.833613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 486/964] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Oct 2 01:07:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 02 01:07:11.844414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2aa7f2ef-d8da-4ef4-add2-a77d40a7152c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:11.845573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2aa7f2ef-d8da-4ef4-add2-a77d40a7152c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:11.898130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2aa7f2ef-d8da-4ef4-add2-a77d40a7152c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:11.905771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2aa7f2ef-d8da-4ef4-add2-a77d40a7152c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1257 microversion: 2.1 time: 0.065217 Oct 02 01:07:11.906380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 479/965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1257 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:12.929849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:12.930421 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:12.936441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:12.936916 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:12.937348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:12.938028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:12.939118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:12.939551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:13.003721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:13.011397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-983be359-8d92-45c8-aaa5-c5926246a25f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1309 microversion: 2.1 time: 0.086302 Oct 02 01:07:13.011953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 487/966] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:14.043416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:14.044516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:14.054301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:14.055113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:14.055738 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:14.056619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:14.057253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:14.057686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:14.217117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:14.225322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-12daa434-cdd0-4619-b464-21fdd80e9faa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.188664 Oct 02 01:07:14.226592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 480/967] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:15.248871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:15.250164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:15.257252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:15.257919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:15.258505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:15.259223 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:15.259678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:15.260114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:15.398848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:15.407814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2351c45f-ff25-4fea-9b5b-1344db91641f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.162886 Oct 02 01:07:15.408424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 488/968] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:16.430393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:16.431008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:16.438024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:16.439098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:16.439747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:16.440855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:16.441478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:16.442104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:16.573198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:16.581933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4e808450-eccd-4c2f-ba6b-f4af86d05dd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.155439 Oct 02 01:07:16.583175 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 481/969] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:17.605514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:17.606455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:17.613741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:17.614267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:17.614707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:17.615472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:17.616117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:17.616584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:17.754414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:17.762389 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8418142-791e-4b6b-976d-2f7f126fa88f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.161278 Oct 02 01:07:17.763669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 489/970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:18.785288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:18.785919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:18.792420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:18.792903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:18.793427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:18.794163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:18.794784 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:18.795211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:18.930215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:18.937967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-362c88ae-3373-4bd5-ae1a-1d246f332ad2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.157103 Oct 02 01:07:18.938799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 482/971] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:19.961974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:19.962710 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:19.968786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:19.969267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:19.970238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:19.970926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:19.971373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:19.971793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:20.107024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:20.115686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ca0dc747-8694-4dd2-ac0a-1752dd9976d2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.158716 Oct 02 01:07:20.116244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 490/972] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:21.137984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:21.138637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:21.145049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:21.145530 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:21.145953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:21.146670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:21.147118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:21.147540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:21.271378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:21.278918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-60a908ef-527b-4295-8313-0b9be08ddc2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.144797 Oct 02 01:07:21.279475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 483/973] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:22.301019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:22.302016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:22.304508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:22.305360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:22.311953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:22.312452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:22.312895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:22.314130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:22.314589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:22.315025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:22.489939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-412332ff-281e-493d-af02-9d072d620127 req-3180ab67-2941-4ea9-bcd9-7d5542fcce5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf3492e-1bdf-44e5-a0dc-e15824c17792", "tag": "11ca2fd5-4b7b-457f-ad93-842be00a9d18"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:22.495055 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=6 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:07:22.502325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-412332ff-281e-493d-af02-9d072d620127 req-3180ab67-2941-4ea9-bcd9-7d5542fcce5e service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:22.502812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-412332ff-281e-493d-af02-9d072d620127 req-3180ab67-2941-4ea9-bcd9-7d5542fcce5e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:22.503243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-412332ff-281e-493d-af02-9d072d620127 req-3180ab67-2941-4ea9-bcd9-7d5542fcce5e service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:22.514367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-412332ff-281e-493d-af02-9d072d620127 req-3180ab67-2941-4ea9-bcd9-7d5542fcce5e service nova] Creating event network-changed:11ca2fd5-4b7b-457f-ad93-842be00a9d18 for instance bcf3492e-1bdf-44e5-a0dc-e15824c17792 on hv-cinder-maste Oct 02 01:07:22.519925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-412332ff-281e-493d-af02-9d072d620127 req-3180ab67-2941-4ea9-bcd9-7d5542fcce5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033896 Oct 02 01:07:22.520521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 484/974] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:07:22.554218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:22.561976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3cd6856-6f66-47f8-8004-8ac2c67ddd86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.264896 Oct 02 01:07:22.562571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 491/975] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:23.586208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:23.586913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:23.592996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:23.593505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:23.593943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:23.595301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:23.595762 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:23.596220 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:23.724799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:23.732391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d8482eb1-b537-4869-bf6e-3449af098d62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.150863 Oct 02 01:07:23.732946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 485/976] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:24.754347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:24.754955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:24.761277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:24.761750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:24.762205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:24.762883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:24.763332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:24.763750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:24.891128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:24.899130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0db062b2-23be-4503-93fa-e41d74c9b158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.148694 Oct 02 01:07:24.899694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 492/977] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:25.922131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:25.922744 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:25.929076 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:25.929549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:25.929975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:25.930686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:25.931133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:25.931559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:26.057543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:26.065676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bd065114-c9cf-4245-9203-752edbc1f914 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.147427 Oct 02 01:07:26.066269 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 486/978] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:27.088509 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:27.089119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:27.096118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:27.096596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:27.097031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:27.097724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:27.098219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:27.098649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:27.224746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:27.232375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6878b2c4-246b-4ba2-8947-ca1205c26dcc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.147761 Oct 02 01:07:27.232882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 493/979] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:07:28.254301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:28.255089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3a44fe57-3bd8-4514-acfb-f34d928aaa7d req-935edff1-a472-4681-951e-b06b2efa16af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf3492e-1bdf-44e5-a0dc-e15824c17792", "name": "network-vif-plugged", "status": "completed", "tag": "11ca2fd5-4b7b-457f-ad93-842be00a9d18"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:28.255497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:28.261405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:28.261894 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:28.262381 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:28.263081 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:28.263529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:28.263950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:28.265438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a44fe57-3bd8-4514-acfb-f34d928aaa7d req-935edff1-a472-4681-951e-b06b2efa16af service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:28.266029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a44fe57-3bd8-4514-acfb-f34d928aaa7d req-935edff1-a472-4681-951e-b06b2efa16af service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:28.266585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a44fe57-3bd8-4514-acfb-f34d928aaa7d req-935edff1-a472-4681-951e-b06b2efa16af service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:28.280295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3a44fe57-3bd8-4514-acfb-f34d928aaa7d req-935edff1-a472-4681-951e-b06b2efa16af service nova] Creating event network-vif-plugged:11ca2fd5-4b7b-457f-ad93-842be00a9d18 for instance bcf3492e-1bdf-44e5-a0dc-e15824c17792 on hv-cinder-maste Oct 02 01:07:28.285913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3a44fe57-3bd8-4514-acfb-f34d928aaa7d req-935edff1-a472-4681-951e-b06b2efa16af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034578 Oct 02 01:07:28.286940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 494/980] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:07:28.394805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:28.402562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-504847ba-6c87-4a15-b984-58c87ffe52ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.152244 Oct 02 01:07:28.403512 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 487/981] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:29.427085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:29.427816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:29.433960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:29.434463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:29.434895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:29.435579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:29.436030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:29.436449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:29.568940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:29.576527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f773185a-b344-4838-9059-f7fe052ef3a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1357 microversion: 2.1 time: 0.154676 Oct 02 01:07:29.577086 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 495/982] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:30.598632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:30.599246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:30.605599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.606102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.606545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.607238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.607689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.608114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.732245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:30.740090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cf432873-a6b3-484c-affd-87fc5dc5aeea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1547 microversion: 2.1 time: 0.145330 Oct 02 01:07:30.740658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 488/983] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:30.762232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:30.762841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:30.769843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.770341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.770775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.771459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.771908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.772329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.901932 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:30.909706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee710ea3-59c4-4b09-8b49-2c0aa0a8bcb4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1547 microversion: 2.1 time: 0.151314 Oct 02 01:07:30.910304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 496/984] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:30.931661 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:30.936469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:30.937231 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Searching by: {'deleted': False, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348'} {{(pid=120424) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 02 01:07:30.944472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.944949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.945384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:30.946138 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:30.946598 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:30.947025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:31.036907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.multi_cell_list [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120424) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 02 01:07:31.284144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d16c163b-7d89-4280-85a5-ecdc4d32d8c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.356140 Oct 02 01:07:31.284721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 489/985] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Oct 2 01:07:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:07:31.296118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:07:31.296854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:31.303173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:31.303661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:31.304098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:31.304818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:31.305271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:31.305691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:31.428820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:07:31.436392 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15a2802d-51b2-4f12-92e9-9a01cadb065f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1547 microversion: 2.1 time: 0.144019 Oct 02 01:07:31.436949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 497/986] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:07:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1547 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:07:32.973065 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-abbdd1e6-03f2-4e7a-a209-46d1a5c67a86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7091bbe8-0989-4d3e-8f30-ee0a64181bc3"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:07:32.975377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-abbdd1e6-03f2-4e7a-a209-46d1a5c67a86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:07:32.982100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbdd1e6-03f2-4e7a-a209-46d1a5c67a86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:32.982208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbdd1e6-03f2-4e7a-a209-46d1a5c67a86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:32.982631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbdd1e6-03f2-4e7a-a209-46d1a5c67a86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:32.983400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbdd1e6-03f2-4e7a-a209-46d1a5c67a86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:07:32.983855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbdd1e6-03f2-4e7a-a209-46d1a5c67a86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:07:32.984276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbdd1e6-03f2-4e7a-a209-46d1a5c67a86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:07:33.243800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-abbdd1e6-03f2-4e7a-a209-46d1a5c67a86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274608 Oct 02 01:07:33.244458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 490/987] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Oct 2 01:07:32 2022] POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:28.408184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:28.409031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:28.411555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:28.412216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=64 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:28.417983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:28.418504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:28.418956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:28.419654 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:28.420113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:28.420534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:28.552261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:28.560455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd1d6fed-a28f-442a-ab79-a04be0152d28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1593 microversion: 2.1 time: 0.156050 Oct 02 01:08:28.561020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 498/988] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:30.180742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell0:SELECT=2 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:30.181877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:30.182685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:08:30.186977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-9f1925f4-29cc-4130-8c0b-de6c1a0c698e req-15b52c5b-d0f4-4adc-8581-a6eb0c8a91bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf3492e-1bdf-44e5-a0dc-e15824c17792", "tag": "11ca2fd5-4b7b-457f-ad93-842be00a9d18"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:30.203573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9f1925f4-29cc-4130-8c0b-de6c1a0c698e req-15b52c5b-d0f4-4adc-8581-a6eb0c8a91bc service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:30.204091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9f1925f4-29cc-4130-8c0b-de6c1a0c698e req-15b52c5b-d0f4-4adc-8581-a6eb0c8a91bc service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:30.204552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-9f1925f4-29cc-4130-8c0b-de6c1a0c698e req-15b52c5b-d0f4-4adc-8581-a6eb0c8a91bc service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:30.217031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-9f1925f4-29cc-4130-8c0b-de6c1a0c698e req-15b52c5b-d0f4-4adc-8581-a6eb0c8a91bc service nova] Creating event network-changed:11ca2fd5-4b7b-457f-ad93-842be00a9d18 for instance bcf3492e-1bdf-44e5-a0dc-e15824c17792 on hv-cinder-maste Oct 02 01:08:30.222258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-9f1925f4-29cc-4130-8c0b-de6c1a0c698e req-15b52c5b-d0f4-4adc-8581-a6eb0c8a91bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042791 Oct 02 01:08:30.223036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 491/989] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:31.478843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2076947066"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:31.479375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:31.486003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.486514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.486946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:31.487695 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.488154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.489320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:31.611774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.network.security_group_api [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Adding security group e74154d2-259d-49c2-a0cb-87cc49f8dac2 to port 11ca2fd5-4b7b-457f-ad93-842be00a9d18 Oct 02 01:08:31.911597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95dfc12a-0d60-4dae-9628-9b1e4c2d0a94 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/action" status: 202 len: 0 microversion: 2.1 time: 0.436590 Oct 02 01:08:31.912210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 499/990] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 01:08:31 2022] POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:08:31.921864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:31.922608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:31.929451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.929932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.930402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:31.931100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:31.931554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:31.931985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.082522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:32.090786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-331654e5-b948-491d-b93d-652429eee268 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1759 microversion: 2.1 time: 0.173680 Oct 02 01:08:32.091355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 492/991] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:32.237278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d8491912-7dcb-48b4-92b6-0af7f95186f9 req-b37874ea-64aa-47aa-bb7b-d19125677b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf3492e-1bdf-44e5-a0dc-e15824c17792", "tag": "11ca2fd5-4b7b-457f-ad93-842be00a9d18"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:32.247496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8491912-7dcb-48b4-92b6-0af7f95186f9 req-b37874ea-64aa-47aa-bb7b-d19125677b9d service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:32.248048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8491912-7dcb-48b4-92b6-0af7f95186f9 req-b37874ea-64aa-47aa-bb7b-d19125677b9d service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:32.248480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8491912-7dcb-48b4-92b6-0af7f95186f9 req-b37874ea-64aa-47aa-bb7b-d19125677b9d service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:32.260046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d8491912-7dcb-48b4-92b6-0af7f95186f9 req-b37874ea-64aa-47aa-bb7b-d19125677b9d service nova] Creating event network-changed:11ca2fd5-4b7b-457f-ad93-842be00a9d18 for instance bcf3492e-1bdf-44e5-a0dc-e15824c17792 on hv-cinder-maste Oct 02 01:08:32.265223 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d8491912-7dcb-48b4-92b6-0af7f95186f9 req-b37874ea-64aa-47aa-bb7b-d19125677b9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032284 Oct 02 01:08:32.265814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 500/992] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:08:33.302186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c61f92ae-99a6-492c-8025-10b71a8ddff8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:08:33.304433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c61f92ae-99a6-492c-8025-10b71a8ddff8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:33.310959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c61f92ae-99a6-492c-8025-10b71a8ddff8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.311443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c61f92ae-99a6-492c-8025-10b71a8ddff8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.311881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c61f92ae-99a6-492c-8025-10b71a8ddff8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.312567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c61f92ae-99a6-492c-8025-10b71a8ddff8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.313021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c61f92ae-99a6-492c-8025-10b71a8ddff8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.313443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c61f92ae-99a6-492c-8025-10b71a8ddff8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.381707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c61f92ae-99a6-492c-8025-10b71a8ddff8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/action" status: 202 len: 0 microversion: 2.1 time: 0.083865 Oct 02 01:08:33.385350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 493/993] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 01:08:33 2022] POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:08:33.391526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:33.392300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:33.398605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.399112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.399515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.400208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:33.400736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:33.401186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:33.619449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:33.627822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72f4d000-76ff-486d-857d-f2d3d09528f1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1751 microversion: 2.1 time: 0.240943 Oct 02 01:08:33.628394 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 501/994] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1751 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:34.651786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:34.652483 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:34.658539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:34.659013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:34.659447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:34.660130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:34.660595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:34.661015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:34.803522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:34.811673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7e4edd60-61f7-4e88-8485-7f37b08875c9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.164458 Oct 02 01:08:34.812238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 494/995] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:35.835719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:35.836263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:35.842851 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.843334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.843778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.844472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:35.844927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:35.845354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:35.995641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:36.003933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd5904f5-af39-4a91-8e95-e6828d1864e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.172830 Oct 02 01:08:36.005203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 502/996] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:37.027449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:37.028056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:37.034622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.035101 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.036118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.036867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:37.037316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:37.037731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:37.181919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:37.190043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ffac82d1-f86f-4d78-9a5e-7364d427b4c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.166521 Oct 02 01:08:37.190617 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 495/997] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:38.213343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:38.214237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:38.221848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:38.222367 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:38.222801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:38.223493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:38.223961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:38.224380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:38.362748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:38.371841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fdc443c0-8e3b-4a4e-8532-d80588f9048c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.162628 Oct 02 01:08:38.372400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 503/998] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:39.396841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:39.397829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:39.404576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.405048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.405476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.406190 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:39.406639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:39.407057 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:39.544464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:39.552564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0d89a245-5d7f-45db-b424-ab3a31900187 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.160927 Oct 02 01:08:39.553132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 496/999] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:40.575774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:40.576384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:40.583418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.583909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.584344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.585031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:40.585487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:40.585911 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:40.726892 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:40.735186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3931e4ca-5d65-4f38-b823-b5da98e61428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.163285 Oct 02 01:08:40.735759 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 504/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:41.758364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:41.758972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:41.765912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.766427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.766858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.767548 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:41.767997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:41.768414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:41.907999 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:41.916838 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d0ec9165-2934-48d7-8d2e-cf574ca73e40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.162233 Oct 02 01:08:41.917396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 497/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:42.939728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:42.940384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:42.947439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.947923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.948361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:42.949054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:42.949510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:42.949938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:43.090640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:43.099470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19b406ea-5eaf-4acd-8c61-95f81fa390b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.163633 Oct 02 01:08:43.100031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 505/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:44.123356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:44.124075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:44.131455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:44.132294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:44.132996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:44.133713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:44.134377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:44.134889 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:44.274676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:44.282871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d5ac31cb-7a9e-4fc5-a126-b7a887892357 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.163458 Oct 02 01:08:44.283430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 498/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:45.305391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:45.306044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:45.312518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:45.312999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:45.313437 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:45.314165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:45.314620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:45.315045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:45.451755 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:45.460054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9baa7d63-2c55-4f62-a08e-0a42fb61f12e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.159221 Oct 02 01:08:45.460620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 506/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:46.483431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:46.484050 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:46.491043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.491527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.491966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.492662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:46.493118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:46.493545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:46.634422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:46.642729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-be7f2626-edfa-47d8-97fe-5394c9336aa3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.163172 Oct 02 01:08:46.643292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 499/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:47.665357 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:47.665959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:47.672358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.672830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.673256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.673933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:47.674413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:47.674831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:47.811872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:47.820448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0062db9-3106-4e4f-8073-4357d04dc25a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.158971 Oct 02 01:08:47.821012 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 507/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:48.843672 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:48.844309 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:48.851343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.851818 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.852245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.852927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:48.853375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:48.853793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:48.997202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:49.006099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cd8de8a7-ab50-4a55-969e-d7043d235423 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.166338 Oct 02 01:08:49.006652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 500/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:50.029228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:50.029887 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:50.036997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:50.037480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:50.037908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:50.038624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:50.039075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:50.039496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:50.177356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:50.185566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51464783-f296-4e5d-8ed3-118df1b8e553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.160237 Oct 02 01:08:50.186168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 508/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:51.208660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:51.209278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:51.216242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.216729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.217173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.217872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:51.218363 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:51.218795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:51.361154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:51.369528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f0e37eeb-b873-4947-9b86-a7939327e836 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.165231 Oct 02 01:08:51.370105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 501/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:52.392875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:52.393422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:52.396892 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:08:52.397045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 (ip 10.222.0.25) !!! Oct 02 01:08:52.403605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.404087 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.404525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.405219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:52.405679 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:52.406136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:52.542794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:52.550875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8622268-52b1-46b4-9d4e-3bf954cd4087 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.162005 Oct 02 01:08:52.551435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 509/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:53.573538 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:53.574191 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:53.580793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:53.581276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:53.581715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:53.582446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:53.582903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:53.583333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:53.719144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:53.727696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-20485723-801b-4923-8ebd-14af30dc9b57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.158063 Oct 02 01:08:53.728254 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 502/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:08:54.751139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:54.751729 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:54.758972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:54.759456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:54.759896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:54.760588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:54.761043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:54.761469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:54.902804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:54.911010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ca8f4e6-b772-41c8-87be-ccb532e07754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1756 microversion: 2.1 time: 0.163767 Oct 02 01:08:54.911769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 510/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:08:55.932989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:08:55.933596 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:08:55.940046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:55.940522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:55.940953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:55.941664 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:08:55.942128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:08:55.943046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:08:56.081874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:08:56.090776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9805d8a4-eea3-43f4-9b2b-97fb749129ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1759 microversion: 2.1 time: 0.161703 Oct 02 01:08:56.091347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 503/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:08:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:09:29.046565 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2076947066"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:29.047107 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:29.049527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=26 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:29.050204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=72 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:29.056379 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.056873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.057309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.058015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.058496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.058923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.188615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.network.security_group_api [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Removing security group e74154d2-259d-49c2-a0cb-87cc49f8dac2 from port 11ca2fd5-4b7b-457f-ad93-842be00a9d18 Oct 02 01:09:29.477236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f4840a0-4769-43e4-877f-ecdba4f029bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/action" status: 202 len: 0 microversion: 2.1 time: 0.434544 Oct 02 01:09:29.477855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 511/1014] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 01:09:29 2022] POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:09:29.488640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-de7afa40-16f6-4c44-806a-408b2e8715a7 req-f0d0a3a7-9f7e-4e32-9fa4-843ee9096ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf3492e-1bdf-44e5-a0dc-e15824c17792", "tag": "11ca2fd5-4b7b-457f-ad93-842be00a9d18"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:29.495700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=26 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:29.496364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:29.503592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-de7afa40-16f6-4c44-806a-408b2e8715a7 req-f0d0a3a7-9f7e-4e32-9fa4-843ee9096ea0 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:29.514083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-de7afa40-16f6-4c44-806a-408b2e8715a7 req-f0d0a3a7-9f7e-4e32-9fa4-843ee9096ea0 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:29.514083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-de7afa40-16f6-4c44-806a-408b2e8715a7 req-f0d0a3a7-9f7e-4e32-9fa4-843ee9096ea0 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:29.546312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-de7afa40-16f6-4c44-806a-408b2e8715a7 req-f0d0a3a7-9f7e-4e32-9fa4-843ee9096ea0 service nova] Creating event network-changed:11ca2fd5-4b7b-457f-ad93-842be00a9d18 for instance bcf3492e-1bdf-44e5-a0dc-e15824c17792 on hv-cinder-maste Oct 02 01:09:29.552346 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-de7afa40-16f6-4c44-806a-408b2e8715a7 req-f0d0a3a7-9f7e-4e32-9fa4-843ee9096ea0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066768 Oct 02 01:09:29.553126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 504/1015] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:31.070119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:31.070681 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:31.076745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.077307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.077838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.078630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.079164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.079673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.161457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lazy-loading 'services' on Instance uuid bcf3492e-1bdf-44e5-a0dc-e15824c17792 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:09:31.233439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79f04a3e-af17-4a37-af6d-12d7d9c00e18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments/7091bbe8-0989-4d3e-8f30-ee0a64181bc3" status: 202 len: 0 microversion: 2.1 time: 0.168262 Oct 02 01:09:31.234586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 512/1016] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 01:09:31 2022] DELETE /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments/7091bbe8-0989-4d3e-8f30-ee0a64181bc3 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 02 01:09:31.249044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5d4e5c72-45c8-4609-89e7-e61f6c29ed03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:31.251391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5d4e5c72-45c8-4609-89e7-e61f6c29ed03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:31.260057 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d4e5c72-45c8-4609-89e7-e61f6c29ed03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.260549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d4e5c72-45c8-4609-89e7-e61f6c29ed03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.261164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d4e5c72-45c8-4609-89e7-e61f6c29ed03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.261875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d4e5c72-45c8-4609-89e7-e61f6c29ed03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.262350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d4e5c72-45c8-4609-89e7-e61f6c29ed03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.262772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d4e5c72-45c8-4609-89e7-e61f6c29ed03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.293731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5d4e5c72-45c8-4609-89e7-e61f6c29ed03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049533 Oct 02 01:09:31.294337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 505/1017] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:31.572180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3ad4ed1b-860b-47a6-8d12-ba16decff7c4 req-efca708e-1d06-4ed4-ac58-842c96015300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf3492e-1bdf-44e5-a0dc-e15824c17792", "tag": "11ca2fd5-4b7b-457f-ad93-842be00a9d18"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:09:31.582410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ad4ed1b-860b-47a6-8d12-ba16decff7c4 req-efca708e-1d06-4ed4-ac58-842c96015300 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:31.583050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ad4ed1b-860b-47a6-8d12-ba16decff7c4 req-efca708e-1d06-4ed4-ac58-842c96015300 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:31.583493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ad4ed1b-860b-47a6-8d12-ba16decff7c4 req-efca708e-1d06-4ed4-ac58-842c96015300 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:31.595330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3ad4ed1b-860b-47a6-8d12-ba16decff7c4 req-efca708e-1d06-4ed4-ac58-842c96015300 service nova] Creating event network-changed:11ca2fd5-4b7b-457f-ad93-842be00a9d18 for instance bcf3492e-1bdf-44e5-a0dc-e15824c17792 on hv-cinder-maste Oct 02 01:09:31.600977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3ad4ed1b-860b-47a6-8d12-ba16decff7c4 req-efca708e-1d06-4ed4-ac58-842c96015300 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032835 Oct 02 01:09:31.601797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 513/1018] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:32.306822 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9d321bc9-9ffa-4a10-b36c-fa041d720103 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:32.309044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9d321bc9-9ffa-4a10-b36c-fa041d720103 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:32.315454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d321bc9-9ffa-4a10-b36c-fa041d720103 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:32.315937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d321bc9-9ffa-4a10-b36c-fa041d720103 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:32.316370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d321bc9-9ffa-4a10-b36c-fa041d720103 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:32.317579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d321bc9-9ffa-4a10-b36c-fa041d720103 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:32.318027 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d321bc9-9ffa-4a10-b36c-fa041d720103 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:32.318485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9d321bc9-9ffa-4a10-b36c-fa041d720103 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:32.347656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9d321bc9-9ffa-4a10-b36c-fa041d720103 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044857 Oct 02 01:09:32.348227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 506/1019] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:33.361105 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72106dcd-01e3-4cb3-991a-81da01a19cc3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:33.363398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72106dcd-01e3-4cb3-991a-81da01a19cc3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:33.369751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72106dcd-01e3-4cb3-991a-81da01a19cc3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:33.370277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72106dcd-01e3-4cb3-991a-81da01a19cc3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:33.370715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72106dcd-01e3-4cb3-991a-81da01a19cc3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.371403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72106dcd-01e3-4cb3-991a-81da01a19cc3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:33.371857 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72106dcd-01e3-4cb3-991a-81da01a19cc3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:33.372285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72106dcd-01e3-4cb3-991a-81da01a19cc3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:33.401060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72106dcd-01e3-4cb3-991a-81da01a19cc3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Oct 02 01:09:33.401607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 514/1020] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:34.413353 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-da2b3958-d41c-4724-ba78-c63a084dc34d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:34.415496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-da2b3958-d41c-4724-ba78-c63a084dc34d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:34.421874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2b3958-d41c-4724-ba78-c63a084dc34d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:34.422391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2b3958-d41c-4724-ba78-c63a084dc34d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:34.422829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2b3958-d41c-4724-ba78-c63a084dc34d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:34.423519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2b3958-d41c-4724-ba78-c63a084dc34d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:34.423971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2b3958-d41c-4724-ba78-c63a084dc34d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:34.424398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2b3958-d41c-4724-ba78-c63a084dc34d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:34.454437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-da2b3958-d41c-4724-ba78-c63a084dc34d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045484 Oct 02 01:09:34.455003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 507/1021] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:35.467212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-13e6b4d4-0bb3-4512-a062-f93d7c7d656e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:35.469264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-13e6b4d4-0bb3-4512-a062-f93d7c7d656e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:35.475961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e6b4d4-0bb3-4512-a062-f93d7c7d656e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:35.476440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e6b4d4-0bb3-4512-a062-f93d7c7d656e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:35.476872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e6b4d4-0bb3-4512-a062-f93d7c7d656e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.477554 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e6b4d4-0bb3-4512-a062-f93d7c7d656e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:35.478002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e6b4d4-0bb3-4512-a062-f93d7c7d656e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:35.478451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13e6b4d4-0bb3-4512-a062-f93d7c7d656e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:35.508255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-13e6b4d4-0bb3-4512-a062-f93d7c7d656e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Oct 02 01:09:35.508803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 515/1022] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:36.521048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b165826e-5968-4ac0-8d45-b59d83c8189e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:36.523214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b165826e-5968-4ac0-8d45-b59d83c8189e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:36.529640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b165826e-5968-4ac0-8d45-b59d83c8189e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.530144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b165826e-5968-4ac0-8d45-b59d83c8189e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.530581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b165826e-5968-4ac0-8d45-b59d83c8189e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.531267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b165826e-5968-4ac0-8d45-b59d83c8189e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:36.531717 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b165826e-5968-4ac0-8d45-b59d83c8189e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:36.532141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b165826e-5968-4ac0-8d45-b59d83c8189e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:36.560566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b165826e-5968-4ac0-8d45-b59d83c8189e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Oct 02 01:09:36.561114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 508/1023] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:37.572969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1022630a-9c41-49fe-bf9c-69f62abdee45 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:37.575136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1022630a-9c41-49fe-bf9c-69f62abdee45 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:37.581089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1022630a-9c41-49fe-bf9c-69f62abdee45 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.581572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1022630a-9c41-49fe-bf9c-69f62abdee45 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.582002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1022630a-9c41-49fe-bf9c-69f62abdee45 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.582813 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1022630a-9c41-49fe-bf9c-69f62abdee45 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:37.583263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1022630a-9c41-49fe-bf9c-69f62abdee45 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:37.583686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1022630a-9c41-49fe-bf9c-69f62abdee45 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:37.612740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1022630a-9c41-49fe-bf9c-69f62abdee45 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Oct 02 01:09:37.613288 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 516/1024] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:38.626575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f33a99bd-76d1-4719-a399-9435169cdd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:38.628700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f33a99bd-76d1-4719-a399-9435169cdd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:38.635755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33a99bd-76d1-4719-a399-9435169cdd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.636234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33a99bd-76d1-4719-a399-9435169cdd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.636668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33a99bd-76d1-4719-a399-9435169cdd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.637359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33a99bd-76d1-4719-a399-9435169cdd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:38.637812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33a99bd-76d1-4719-a399-9435169cdd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:38.638277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33a99bd-76d1-4719-a399-9435169cdd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:38.666376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f33a99bd-76d1-4719-a399-9435169cdd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 Oct 02 01:09:38.666921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 509/1025] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:39.678799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3052950c-514a-4e08-af20-1c6e5cb57db7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:39.680969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3052950c-514a-4e08-af20-1c6e5cb57db7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:39.687494 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3052950c-514a-4e08-af20-1c6e5cb57db7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:39.687977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3052950c-514a-4e08-af20-1c6e5cb57db7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:39.688409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3052950c-514a-4e08-af20-1c6e5cb57db7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:39.689095 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3052950c-514a-4e08-af20-1c6e5cb57db7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:39.689550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3052950c-514a-4e08-af20-1c6e5cb57db7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:39.689975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3052950c-514a-4e08-af20-1c6e5cb57db7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:39.718502 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3052950c-514a-4e08-af20-1c6e5cb57db7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044247 Oct 02 01:09:39.719055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 517/1026] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:09:40.731835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-520213f6-65e5-4912-b7ce-eb416ba9ab3f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:40.733906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-520213f6-65e5-4912-b7ce-eb416ba9ab3f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:40.741165 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-520213f6-65e5-4912-b7ce-eb416ba9ab3f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.741643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-520213f6-65e5-4912-b7ce-eb416ba9ab3f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.742091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-520213f6-65e5-4912-b7ce-eb416ba9ab3f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.742777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-520213f6-65e5-4912-b7ce-eb416ba9ab3f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:40.743226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-520213f6-65e5-4912-b7ce-eb416ba9ab3f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:40.743647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-520213f6-65e5-4912-b7ce-eb416ba9ab3f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:40.772107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-520213f6-65e5-4912-b7ce-eb416ba9ab3f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044258 Oct 02 01:09:40.772650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 510/1027] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:41.784385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d956f4d2-c9e4-4743-b255-608d1beb4bf3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:41.787228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d956f4d2-c9e4-4743-b255-608d1beb4bf3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:41.793624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d956f4d2-c9e4-4743-b255-608d1beb4bf3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:41.794135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d956f4d2-c9e4-4743-b255-608d1beb4bf3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:41.794577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d956f4d2-c9e4-4743-b255-608d1beb4bf3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:41.795269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d956f4d2-c9e4-4743-b255-608d1beb4bf3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:41.795725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d956f4d2-c9e4-4743-b255-608d1beb4bf3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:41.796150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d956f4d2-c9e4-4743-b255-608d1beb4bf3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:41.824385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d956f4d2-c9e4-4743-b255-608d1beb4bf3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Oct 02 01:09:41.824925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 518/1028] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:42.836808 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b25f99b5-4153-438b-997d-73498cd9c64c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:42.838992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b25f99b5-4153-438b-997d-73498cd9c64c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:42.845336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b25f99b5-4153-438b-997d-73498cd9c64c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.845818 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b25f99b5-4153-438b-997d-73498cd9c64c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.846297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b25f99b5-4153-438b-997d-73498cd9c64c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.846992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b25f99b5-4153-438b-997d-73498cd9c64c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:42.847447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b25f99b5-4153-438b-997d-73498cd9c64c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:42.847877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b25f99b5-4153-438b-997d-73498cd9c64c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:42.877319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b25f99b5-4153-438b-997d-73498cd9c64c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 Oct 02 01:09:42.877858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 511/1029] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:43.888892 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-afdde106-95e3-4bf8-868d-d2bf65f87b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:43.891094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-afdde106-95e3-4bf8-868d-d2bf65f87b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:43.897349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdde106-95e3-4bf8-868d-d2bf65f87b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:43.897834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdde106-95e3-4bf8-868d-d2bf65f87b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:43.898308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdde106-95e3-4bf8-868d-d2bf65f87b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:43.898999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdde106-95e3-4bf8-868d-d2bf65f87b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:43.899452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdde106-95e3-4bf8-868d-d2bf65f87b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:43.899879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afdde106-95e3-4bf8-868d-d2bf65f87b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:43.928619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-afdde106-95e3-4bf8-868d-d2bf65f87b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Oct 02 01:09:43.929164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 519/1030] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:44.940949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d6344a72-15f0-432a-b639-8ea3a1c7747d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:44.943182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d6344a72-15f0-432a-b639-8ea3a1c7747d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:44.949555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6344a72-15f0-432a-b639-8ea3a1c7747d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.950039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6344a72-15f0-432a-b639-8ea3a1c7747d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.950507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6344a72-15f0-432a-b639-8ea3a1c7747d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:44.951205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6344a72-15f0-432a-b639-8ea3a1c7747d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:44.951660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6344a72-15f0-432a-b639-8ea3a1c7747d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:44.952086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6344a72-15f0-432a-b639-8ea3a1c7747d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:44.980497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d6344a72-15f0-432a-b639-8ea3a1c7747d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 Oct 02 01:09:44.981043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 512/1031] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:45.993556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3fdaa54b-f209-41a4-838d-f5bd92f161bd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:45.995775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3fdaa54b-f209-41a4-838d-f5bd92f161bd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:46.002256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdaa54b-f209-41a4-838d-f5bd92f161bd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:46.002735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdaa54b-f209-41a4-838d-f5bd92f161bd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:46.003167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdaa54b-f209-41a4-838d-f5bd92f161bd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:46.003851 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdaa54b-f209-41a4-838d-f5bd92f161bd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:46.004959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdaa54b-f209-41a4-838d-f5bd92f161bd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:46.005383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3fdaa54b-f209-41a4-838d-f5bd92f161bd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:46.033779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3fdaa54b-f209-41a4-838d-f5bd92f161bd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Oct 02 01:09:46.034373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 520/1032] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:47.046276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cbc68260-9eff-40f4-8602-cf2685f9aefa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:47.048432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cbc68260-9eff-40f4-8602-cf2685f9aefa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:47.054926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbc68260-9eff-40f4-8602-cf2685f9aefa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.055413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbc68260-9eff-40f4-8602-cf2685f9aefa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.055854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbc68260-9eff-40f4-8602-cf2685f9aefa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.056552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbc68260-9eff-40f4-8602-cf2685f9aefa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:47.057009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbc68260-9eff-40f4-8602-cf2685f9aefa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:47.057438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbc68260-9eff-40f4-8602-cf2685f9aefa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:47.086491 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cbc68260-9eff-40f4-8602-cf2685f9aefa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Oct 02 01:09:47.087050 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 513/1033] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:48.098937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5062d4db-2929-466f-84f5-d748a45f70ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:48.101098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5062d4db-2929-466f-84f5-d748a45f70ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:48.107579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5062d4db-2929-466f-84f5-d748a45f70ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:48.108058 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5062d4db-2929-466f-84f5-d748a45f70ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:48.108497 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5062d4db-2929-466f-84f5-d748a45f70ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:48.109183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5062d4db-2929-466f-84f5-d748a45f70ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:48.109637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5062d4db-2929-466f-84f5-d748a45f70ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:48.110092 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5062d4db-2929-466f-84f5-d748a45f70ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:48.139601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5062d4db-2929-466f-84f5-d748a45f70ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Oct 02 01:09:48.140144 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 521/1034] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:49.151955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-61f66fdb-3ff1-4d04-8f69-c70c6a074734 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:49.154182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-61f66fdb-3ff1-4d04-8f69-c70c6a074734 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:49.161152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61f66fdb-3ff1-4d04-8f69-c70c6a074734 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.161626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61f66fdb-3ff1-4d04-8f69-c70c6a074734 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.162082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61f66fdb-3ff1-4d04-8f69-c70c6a074734 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.162770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61f66fdb-3ff1-4d04-8f69-c70c6a074734 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:49.163218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61f66fdb-3ff1-4d04-8f69-c70c6a074734 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:49.163637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-61f66fdb-3ff1-4d04-8f69-c70c6a074734 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:49.191523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-61f66fdb-3ff1-4d04-8f69-c70c6a074734 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043488 Oct 02 01:09:49.192073 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 514/1035] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:50.203493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd11a288-b64c-4ed4-964b-b1de81157e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:50.205570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd11a288-b64c-4ed4-964b-b1de81157e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:50.212136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd11a288-b64c-4ed4-964b-b1de81157e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.212613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd11a288-b64c-4ed4-964b-b1de81157e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.213045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd11a288-b64c-4ed4-964b-b1de81157e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.213734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd11a288-b64c-4ed4-964b-b1de81157e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:50.214216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd11a288-b64c-4ed4-964b-b1de81157e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:50.214649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd11a288-b64c-4ed4-964b-b1de81157e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:50.243917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd11a288-b64c-4ed4-964b-b1de81157e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Oct 02 01:09:50.244459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 522/1036] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:51.255446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2bfa6a81-edec-4e02-acc5-d66b0e0dca7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:51.257572 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2bfa6a81-edec-4e02-acc5-d66b0e0dca7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:51.264061 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bfa6a81-edec-4e02-acc5-d66b0e0dca7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.264543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bfa6a81-edec-4e02-acc5-d66b0e0dca7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.264975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bfa6a81-edec-4e02-acc5-d66b0e0dca7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:51.265654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bfa6a81-edec-4e02-acc5-d66b0e0dca7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:51.266131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bfa6a81-edec-4e02-acc5-d66b0e0dca7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:51.266555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2bfa6a81-edec-4e02-acc5-d66b0e0dca7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:51.295537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2bfa6a81-edec-4e02-acc5-d66b0e0dca7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Oct 02 01:09:51.296015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 515/1037] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:52.308342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d83dbf0-1f6d-4062-bb6c-ca7c2f995193 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:52.310484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d83dbf0-1f6d-4062-bb6c-ca7c2f995193 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:52.317649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d83dbf0-1f6d-4062-bb6c-ca7c2f995193 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:52.318164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d83dbf0-1f6d-4062-bb6c-ca7c2f995193 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:52.318608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d83dbf0-1f6d-4062-bb6c-ca7c2f995193 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:52.319304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d83dbf0-1f6d-4062-bb6c-ca7c2f995193 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:52.319810 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d83dbf0-1f6d-4062-bb6c-ca7c2f995193 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:52.320239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d83dbf0-1f6d-4062-bb6c-ca7c2f995193 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:52.348473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d83dbf0-1f6d-4062-bb6c-ca7c2f995193 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Oct 02 01:09:52.349024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 523/1038] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:53.360121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8d029b01-f964-4563-9ee9-0fe1277cf24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:53.362218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8d029b01-f964-4563-9ee9-0fe1277cf24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:53.368960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d029b01-f964-4563-9ee9-0fe1277cf24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.369445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d029b01-f964-4563-9ee9-0fe1277cf24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.369890 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d029b01-f964-4563-9ee9-0fe1277cf24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:53.370611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d029b01-f964-4563-9ee9-0fe1277cf24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:53.371071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d029b01-f964-4563-9ee9-0fe1277cf24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:53.371504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d029b01-f964-4563-9ee9-0fe1277cf24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:53.401564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8d029b01-f964-4563-9ee9-0fe1277cf24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045564 Oct 02 01:09:53.402146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 516/1039] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:54.413855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d306646-a0e5-4a5f-8b48-de7150a05b69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:54.416076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d306646-a0e5-4a5f-8b48-de7150a05b69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:54.422544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d306646-a0e5-4a5f-8b48-de7150a05b69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:54.423031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d306646-a0e5-4a5f-8b48-de7150a05b69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:54.423467 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d306646-a0e5-4a5f-8b48-de7150a05b69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:54.424157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d306646-a0e5-4a5f-8b48-de7150a05b69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:54.424613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d306646-a0e5-4a5f-8b48-de7150a05b69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:54.425039 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d306646-a0e5-4a5f-8b48-de7150a05b69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:54.455136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d306646-a0e5-4a5f-8b48-de7150a05b69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Oct 02 01:09:54.455704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 524/1040] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:55.467777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4c8cc182-0e17-4794-a462-db7dd1bbc75d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:55.470622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4c8cc182-0e17-4794-a462-db7dd1bbc75d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:55.477039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c8cc182-0e17-4794-a462-db7dd1bbc75d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:55.477527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c8cc182-0e17-4794-a462-db7dd1bbc75d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:55.477966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c8cc182-0e17-4794-a462-db7dd1bbc75d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:55.478692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c8cc182-0e17-4794-a462-db7dd1bbc75d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:55.479150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c8cc182-0e17-4794-a462-db7dd1bbc75d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:55.479579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c8cc182-0e17-4794-a462-db7dd1bbc75d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:55.508372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4c8cc182-0e17-4794-a462-db7dd1bbc75d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Oct 02 01:09:55.508912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 517/1041] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:56.520703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b17fbe02-7926-4102-aa69-9fd52b1792b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:56.522905 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b17fbe02-7926-4102-aa69-9fd52b1792b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:56.529271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b17fbe02-7926-4102-aa69-9fd52b1792b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:56.529756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b17fbe02-7926-4102-aa69-9fd52b1792b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:56.530230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b17fbe02-7926-4102-aa69-9fd52b1792b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:56.530926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b17fbe02-7926-4102-aa69-9fd52b1792b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:56.531381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b17fbe02-7926-4102-aa69-9fd52b1792b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:56.531808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b17fbe02-7926-4102-aa69-9fd52b1792b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:56.560801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b17fbe02-7926-4102-aa69-9fd52b1792b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Oct 02 01:09:56.561344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 525/1042] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:57.573483 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c9742b69-5544-4c7c-8e74-358ea3ee9fea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:57.575717 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c9742b69-5544-4c7c-8e74-358ea3ee9fea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:57.582188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9742b69-5544-4c7c-8e74-358ea3ee9fea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:57.582672 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9742b69-5544-4c7c-8e74-358ea3ee9fea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:57.583109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9742b69-5544-4c7c-8e74-358ea3ee9fea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:57.583806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9742b69-5544-4c7c-8e74-358ea3ee9fea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:57.584261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9742b69-5544-4c7c-8e74-358ea3ee9fea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:57.584687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9742b69-5544-4c7c-8e74-358ea3ee9fea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:57.612769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c9742b69-5544-4c7c-8e74-358ea3ee9fea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043207 Oct 02 01:09:57.613831 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 518/1043] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:58.625090 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8090b6a2-a39a-4b1b-b011-477632bb5646 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:58.627280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8090b6a2-a39a-4b1b-b011-477632bb5646 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:58.634049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8090b6a2-a39a-4b1b-b011-477632bb5646 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.634559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8090b6a2-a39a-4b1b-b011-477632bb5646 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.634997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8090b6a2-a39a-4b1b-b011-477632bb5646 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.635688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8090b6a2-a39a-4b1b-b011-477632bb5646 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:58.636143 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8090b6a2-a39a-4b1b-b011-477632bb5646 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:58.636570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8090b6a2-a39a-4b1b-b011-477632bb5646 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:58.665529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8090b6a2-a39a-4b1b-b011-477632bb5646 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Oct 02 01:09:58.666106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 526/1044] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:09:59.678005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6bd20579-1853-48a4-95e5-6693e9c2b8e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:09:59.680255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6bd20579-1853-48a4-95e5-6693e9c2b8e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:09:59.682232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=31 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:09:59.687467 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6bd20579-1853-48a4-95e5-6693e9c2b8e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:59.687950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6bd20579-1853-48a4-95e5-6693e9c2b8e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:59.688392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6bd20579-1853-48a4-95e5-6693e9c2b8e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:59.689082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6bd20579-1853-48a4-95e5-6693e9c2b8e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:09:59.689533 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6bd20579-1853-48a4-95e5-6693e9c2b8e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:09:59.689957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6bd20579-1853-48a4-95e5-6693e9c2b8e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:09:59.718882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6bd20579-1853-48a4-95e5-6693e9c2b8e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Oct 02 01:09:59.719420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 519/1045] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:09:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:00.731866 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ae443e2-073c-48e1-b120-79bd306cc3c1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:00.734012 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ae443e2-073c-48e1-b120-79bd306cc3c1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:00.736507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=33 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:00.742845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae443e2-073c-48e1-b120-79bd306cc3c1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:00.743339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae443e2-073c-48e1-b120-79bd306cc3c1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:00.743776 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae443e2-073c-48e1-b120-79bd306cc3c1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:00.744498 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae443e2-073c-48e1-b120-79bd306cc3c1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:00.744955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae443e2-073c-48e1-b120-79bd306cc3c1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:00.745386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae443e2-073c-48e1-b120-79bd306cc3c1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:00.748015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:00.775293 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ae443e2-073c-48e1-b120-79bd306cc3c1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047380 Oct 02 01:10:00.775843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 527/1046] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:01.787720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2c2e675d-5e53-4b75-8ad4-e675cd536aff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:01.789862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2c2e675d-5e53-4b75-8ad4-e675cd536aff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:01.796555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c2e675d-5e53-4b75-8ad4-e675cd536aff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:01.797040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c2e675d-5e53-4b75-8ad4-e675cd536aff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:01.797493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c2e675d-5e53-4b75-8ad4-e675cd536aff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:01.798256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c2e675d-5e53-4b75-8ad4-e675cd536aff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:01.798707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c2e675d-5e53-4b75-8ad4-e675cd536aff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:01.799127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c2e675d-5e53-4b75-8ad4-e675cd536aff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:01.803327 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=93 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:01.830409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2c2e675d-5e53-4b75-8ad4-e675cd536aff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046697 Oct 02 01:10:01.830954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 520/1047] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:02.842700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a533e35f-2d29-4c3a-9572-57476420a719 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:02.844852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a533e35f-2d29-4c3a-9572-57476420a719 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:02.851907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a533e35f-2d29-4c3a-9572-57476420a719 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.852390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a533e35f-2d29-4c3a-9572-57476420a719 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.852823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a533e35f-2d29-4c3a-9572-57476420a719 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.853507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a533e35f-2d29-4c3a-9572-57476420a719 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:02.853962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a533e35f-2d29-4c3a-9572-57476420a719 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:02.854413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a533e35f-2d29-4c3a-9572-57476420a719 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:02.882970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a533e35f-2d29-4c3a-9572-57476420a719 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Oct 02 01:10:02.883509 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 528/1048] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:03.895399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0bef77d0-654b-4e55-ba77-be25039e1008 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:03.897527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0bef77d0-654b-4e55-ba77-be25039e1008 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:03.903850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bef77d0-654b-4e55-ba77-be25039e1008 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:03.904323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bef77d0-654b-4e55-ba77-be25039e1008 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:03.904755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bef77d0-654b-4e55-ba77-be25039e1008 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:03.905438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bef77d0-654b-4e55-ba77-be25039e1008 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:03.905885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bef77d0-654b-4e55-ba77-be25039e1008 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:03.906338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bef77d0-654b-4e55-ba77-be25039e1008 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:03.935329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0bef77d0-654b-4e55-ba77-be25039e1008 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Oct 02 01:10:03.935875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 521/1049] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:04.948324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b25eb48d-d264-4db1-9c86-c32abdd69f4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:04.950439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b25eb48d-d264-4db1-9c86-c32abdd69f4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:04.956928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b25eb48d-d264-4db1-9c86-c32abdd69f4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:04.957408 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b25eb48d-d264-4db1-9c86-c32abdd69f4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:04.957839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b25eb48d-d264-4db1-9c86-c32abdd69f4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:04.958548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b25eb48d-d264-4db1-9c86-c32abdd69f4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:04.958997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b25eb48d-d264-4db1-9c86-c32abdd69f4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:04.959415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b25eb48d-d264-4db1-9c86-c32abdd69f4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:04.987321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b25eb48d-d264-4db1-9c86-c32abdd69f4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Oct 02 01:10:04.987859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 529/1050] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:06.000676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-42b33d11-7d24-47d3-90a8-9bae11de5e8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:06.003849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-42b33d11-7d24-47d3-90a8-9bae11de5e8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:06.011433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b33d11-7d24-47d3-90a8-9bae11de5e8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.012020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b33d11-7d24-47d3-90a8-9bae11de5e8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.012462 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b33d11-7d24-47d3-90a8-9bae11de5e8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.013176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b33d11-7d24-47d3-90a8-9bae11de5e8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:06.013743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b33d11-7d24-47d3-90a8-9bae11de5e8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:06.014201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42b33d11-7d24-47d3-90a8-9bae11de5e8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:06.044438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-42b33d11-7d24-47d3-90a8-9bae11de5e8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047783 Oct 02 01:10:06.045115 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 522/1051] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:07.056428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2316bc19-3fa1-4938-9fa5-e18abf18a79e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:07.058649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2316bc19-3fa1-4938-9fa5-e18abf18a79e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:07.064746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2316bc19-3fa1-4938-9fa5-e18abf18a79e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.065259 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2316bc19-3fa1-4938-9fa5-e18abf18a79e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.065694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2316bc19-3fa1-4938-9fa5-e18abf18a79e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.066419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2316bc19-3fa1-4938-9fa5-e18abf18a79e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:07.066872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2316bc19-3fa1-4938-9fa5-e18abf18a79e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:07.067298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2316bc19-3fa1-4938-9fa5-e18abf18a79e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:07.096191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2316bc19-3fa1-4938-9fa5-e18abf18a79e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043771 Oct 02 01:10:07.096749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 530/1052] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:08.109147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-30cda40e-482b-43e9-baf2-734c0e201916 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:08.111610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-30cda40e-482b-43e9-baf2-734c0e201916 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:08.118932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30cda40e-482b-43e9-baf2-734c0e201916 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:08.119414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30cda40e-482b-43e9-baf2-734c0e201916 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:08.119849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30cda40e-482b-43e9-baf2-734c0e201916 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:08.120542 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30cda40e-482b-43e9-baf2-734c0e201916 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:08.120990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30cda40e-482b-43e9-baf2-734c0e201916 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:08.121915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30cda40e-482b-43e9-baf2-734c0e201916 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:08.150214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-30cda40e-482b-43e9-baf2-734c0e201916 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Oct 02 01:10:08.151113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 523/1053] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:08 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:09.163140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5122ca31-839d-4532-8106-52a4e53561bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:09.165339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5122ca31-839d-4532-8106-52a4e53561bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:09.171881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5122ca31-839d-4532-8106-52a4e53561bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:09.172368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5122ca31-839d-4532-8106-52a4e53561bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:09.172807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5122ca31-839d-4532-8106-52a4e53561bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:09.173505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5122ca31-839d-4532-8106-52a4e53561bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:09.173964 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5122ca31-839d-4532-8106-52a4e53561bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:09.174429 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5122ca31-839d-4532-8106-52a4e53561bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:09.204139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5122ca31-839d-4532-8106-52a4e53561bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Oct 02 01:10:09.204684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 531/1054] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:10.216823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-44542d87-4a1a-4e5f-8494-638e3de66ca0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:10.219078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-44542d87-4a1a-4e5f-8494-638e3de66ca0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:10.225432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44542d87-4a1a-4e5f-8494-638e3de66ca0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.226592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44542d87-4a1a-4e5f-8494-638e3de66ca0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.227035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44542d87-4a1a-4e5f-8494-638e3de66ca0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.227738 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44542d87-4a1a-4e5f-8494-638e3de66ca0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:10.228191 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44542d87-4a1a-4e5f-8494-638e3de66ca0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:10.228611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-44542d87-4a1a-4e5f-8494-638e3de66ca0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:10.260537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-44542d87-4a1a-4e5f-8494-638e3de66ca0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047214 Oct 02 01:10:10.261319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 524/1055] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:11.273424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57546f80-bae7-446e-bd19-6eea4a0582b7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:11.275730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57546f80-bae7-446e-bd19-6eea4a0582b7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:11.282236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57546f80-bae7-446e-bd19-6eea4a0582b7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:11.283076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57546f80-bae7-446e-bd19-6eea4a0582b7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:11.283527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57546f80-bae7-446e-bd19-6eea4a0582b7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.284227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57546f80-bae7-446e-bd19-6eea4a0582b7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:11.284686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57546f80-bae7-446e-bd19-6eea4a0582b7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:11.285118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57546f80-bae7-446e-bd19-6eea4a0582b7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:11.314787 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57546f80-bae7-446e-bd19-6eea4a0582b7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Oct 02 01:10:11.315368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 532/1056] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:12.327100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f75047ae-f491-4e06-8712-6eec0f0f116a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:12.329189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f75047ae-f491-4e06-8712-6eec0f0f116a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:12.335619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75047ae-f491-4e06-8712-6eec0f0f116a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:12.336099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75047ae-f491-4e06-8712-6eec0f0f116a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:12.336529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75047ae-f491-4e06-8712-6eec0f0f116a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:12.337218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75047ae-f491-4e06-8712-6eec0f0f116a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:12.337670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75047ae-f491-4e06-8712-6eec0f0f116a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:12.338109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f75047ae-f491-4e06-8712-6eec0f0f116a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:12.366602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f75047ae-f491-4e06-8712-6eec0f0f116a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Oct 02 01:10:12.367144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 525/1057] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:13.378528 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7595ade8-8a61-4dd0-9b06-0578fd8c62ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:13.380633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7595ade8-8a61-4dd0-9b06-0578fd8c62ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:13.387555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7595ade8-8a61-4dd0-9b06-0578fd8c62ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.388031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7595ade8-8a61-4dd0-9b06-0578fd8c62ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.388461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7595ade8-8a61-4dd0-9b06-0578fd8c62ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.389144 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7595ade8-8a61-4dd0-9b06-0578fd8c62ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:13.389592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7595ade8-8a61-4dd0-9b06-0578fd8c62ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:13.390010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7595ade8-8a61-4dd0-9b06-0578fd8c62ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:13.419171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7595ade8-8a61-4dd0-9b06-0578fd8c62ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044669 Oct 02 01:10:13.419717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 533/1058] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:14.431691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7907c25e-fe0b-40d0-b984-16274cfb919e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:14.433875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7907c25e-fe0b-40d0-b984-16274cfb919e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:14.440339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7907c25e-fe0b-40d0-b984-16274cfb919e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.440795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7907c25e-fe0b-40d0-b984-16274cfb919e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.441258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7907c25e-fe0b-40d0-b984-16274cfb919e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.441950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7907c25e-fe0b-40d0-b984-16274cfb919e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:14.442435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7907c25e-fe0b-40d0-b984-16274cfb919e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:14.442863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7907c25e-fe0b-40d0-b984-16274cfb919e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:14.471238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7907c25e-fe0b-40d0-b984-16274cfb919e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Oct 02 01:10:14.471787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 526/1059] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:15.484038 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ec4e798-a94b-46a5-81df-2d813ca50329 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:15.486210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ec4e798-a94b-46a5-81df-2d813ca50329 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:15.493323 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec4e798-a94b-46a5-81df-2d813ca50329 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.493798 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec4e798-a94b-46a5-81df-2d813ca50329 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.494263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec4e798-a94b-46a5-81df-2d813ca50329 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.494944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec4e798-a94b-46a5-81df-2d813ca50329 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:15.495393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec4e798-a94b-46a5-81df-2d813ca50329 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:15.495822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec4e798-a94b-46a5-81df-2d813ca50329 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:15.524599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ec4e798-a94b-46a5-81df-2d813ca50329 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044510 Oct 02 01:10:15.525594 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 534/1060] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:16.536787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8359c979-3916-415b-9f86-41adcd996853 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:16.538994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8359c979-3916-415b-9f86-41adcd996853 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:16.545366 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8359c979-3916-415b-9f86-41adcd996853 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:16.545843 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8359c979-3916-415b-9f86-41adcd996853 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:16.546303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8359c979-3916-415b-9f86-41adcd996853 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:16.546985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8359c979-3916-415b-9f86-41adcd996853 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:16.547430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8359c979-3916-415b-9f86-41adcd996853 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:16.547852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8359c979-3916-415b-9f86-41adcd996853 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:16.576176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8359c979-3916-415b-9f86-41adcd996853 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Oct 02 01:10:16.576710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 527/1061] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:17.588982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b37eb89e-4235-45a7-bee5-078b2e139d7b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:17.591174 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b37eb89e-4235-45a7-bee5-078b2e139d7b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:17.597404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b37eb89e-4235-45a7-bee5-078b2e139d7b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.597873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b37eb89e-4235-45a7-bee5-078b2e139d7b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.598336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b37eb89e-4235-45a7-bee5-078b2e139d7b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.599018 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b37eb89e-4235-45a7-bee5-078b2e139d7b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:17.599464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b37eb89e-4235-45a7-bee5-078b2e139d7b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:17.599883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b37eb89e-4235-45a7-bee5-078b2e139d7b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:17.629673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b37eb89e-4235-45a7-bee5-078b2e139d7b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Oct 02 01:10:17.630200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 535/1062] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:10:18.642130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a72c9eb4-0166-4bdf-9aeb-def78d92c449 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:18.644272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a72c9eb4-0166-4bdf-9aeb-def78d92c449 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:18.650735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a72c9eb4-0166-4bdf-9aeb-def78d92c449 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:18.651227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a72c9eb4-0166-4bdf-9aeb-def78d92c449 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:18.651652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a72c9eb4-0166-4bdf-9aeb-def78d92c449 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:18.652367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a72c9eb4-0166-4bdf-9aeb-def78d92c449 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:18.652817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a72c9eb4-0166-4bdf-9aeb-def78d92c449 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:18.653272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a72c9eb4-0166-4bdf-9aeb-def78d92c449 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:18.683867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a72c9eb4-0166-4bdf-9aeb-def78d92c449 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Oct 02 01:10:18.684357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 528/1063] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:19.696855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5090e39-ae90-428f-a10d-0af42a7c57ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:19.698967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5090e39-ae90-428f-a10d-0af42a7c57ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:19.705277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5090e39-ae90-428f-a10d-0af42a7c57ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:19.705754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5090e39-ae90-428f-a10d-0af42a7c57ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:19.706214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5090e39-ae90-428f-a10d-0af42a7c57ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:19.706897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5090e39-ae90-428f-a10d-0af42a7c57ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:19.707345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5090e39-ae90-428f-a10d-0af42a7c57ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:19.707764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5090e39-ae90-428f-a10d-0af42a7c57ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:19.735522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5090e39-ae90-428f-a10d-0af42a7c57ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Oct 02 01:10:19.736060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 536/1064] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:20.748130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3bab29c4-57d0-4575-831e-5bc2cc1efcf0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:20.750287 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3bab29c4-57d0-4575-831e-5bc2cc1efcf0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:20.756643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bab29c4-57d0-4575-831e-5bc2cc1efcf0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:20.757113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bab29c4-57d0-4575-831e-5bc2cc1efcf0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:20.757542 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bab29c4-57d0-4575-831e-5bc2cc1efcf0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:20.758256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bab29c4-57d0-4575-831e-5bc2cc1efcf0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:20.758707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bab29c4-57d0-4575-831e-5bc2cc1efcf0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:20.759125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3bab29c4-57d0-4575-831e-5bc2cc1efcf0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:20.787412 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3bab29c4-57d0-4575-831e-5bc2cc1efcf0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043255 Oct 02 01:10:20.787950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 529/1065] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:21.800308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50efe1f8-a895-46a6-9425-feb227eedb17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:21.802511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50efe1f8-a895-46a6-9425-feb227eedb17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:21.809693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50efe1f8-a895-46a6-9425-feb227eedb17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:21.810211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50efe1f8-a895-46a6-9425-feb227eedb17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:21.810719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50efe1f8-a895-46a6-9425-feb227eedb17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:21.811369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50efe1f8-a895-46a6-9425-feb227eedb17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:21.811834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50efe1f8-a895-46a6-9425-feb227eedb17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:21.812265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50efe1f8-a895-46a6-9425-feb227eedb17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:21.840451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50efe1f8-a895-46a6-9425-feb227eedb17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044116 Oct 02 01:10:21.841002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 537/1066] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:22.852891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-092f7db2-999d-49bb-ac7d-eabb63dd93f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:22.854975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-092f7db2-999d-49bb-ac7d-eabb63dd93f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:22.861347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-092f7db2-999d-49bb-ac7d-eabb63dd93f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:22.861819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-092f7db2-999d-49bb-ac7d-eabb63dd93f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:22.862279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-092f7db2-999d-49bb-ac7d-eabb63dd93f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:22.862952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-092f7db2-999d-49bb-ac7d-eabb63dd93f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:22.863397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-092f7db2-999d-49bb-ac7d-eabb63dd93f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:22.863813 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-092f7db2-999d-49bb-ac7d-eabb63dd93f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:22.893089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-092f7db2-999d-49bb-ac7d-eabb63dd93f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044181 Oct 02 01:10:22.893623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 530/1067] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:23.905391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b715140a-a550-4e5a-9057-4f2b3c25f420 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:23.907564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b715140a-a550-4e5a-9057-4f2b3c25f420 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:23.913866 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b715140a-a550-4e5a-9057-4f2b3c25f420 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:23.914380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b715140a-a550-4e5a-9057-4f2b3c25f420 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:23.914817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b715140a-a550-4e5a-9057-4f2b3c25f420 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:23.915499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b715140a-a550-4e5a-9057-4f2b3c25f420 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:23.915946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b715140a-a550-4e5a-9057-4f2b3c25f420 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:23.916367 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b715140a-a550-4e5a-9057-4f2b3c25f420 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:23.944566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b715140a-a550-4e5a-9057-4f2b3c25f420 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043140 Oct 02 01:10:23.945682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 538/1068] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:24.957741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-29866fa0-d8cb-4ed2-8030-159cb680337e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:24.959874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-29866fa0-d8cb-4ed2-8030-159cb680337e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:24.966736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29866fa0-d8cb-4ed2-8030-159cb680337e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:24.967215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29866fa0-d8cb-4ed2-8030-159cb680337e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:24.967648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29866fa0-d8cb-4ed2-8030-159cb680337e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:24.968326 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29866fa0-d8cb-4ed2-8030-159cb680337e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:24.968775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29866fa0-d8cb-4ed2-8030-159cb680337e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:24.969194 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29866fa0-d8cb-4ed2-8030-159cb680337e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:24.997943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-29866fa0-d8cb-4ed2-8030-159cb680337e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044256 Oct 02 01:10:24.998515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 531/1069] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:26.010936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8530aef-f6f3-47c8-88a6-f37351020432 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:26.013114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8530aef-f6f3-47c8-88a6-f37351020432 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:26.019485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8530aef-f6f3-47c8-88a6-f37351020432 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:26.019993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8530aef-f6f3-47c8-88a6-f37351020432 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:26.020421 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8530aef-f6f3-47c8-88a6-f37351020432 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:26.021101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8530aef-f6f3-47c8-88a6-f37351020432 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:26.021549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8530aef-f6f3-47c8-88a6-f37351020432 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:26.021966 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8530aef-f6f3-47c8-88a6-f37351020432 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:26.051332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8530aef-f6f3-47c8-88a6-f37351020432 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Oct 02 01:10:26.051877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 539/1070] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:27.064033 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4a2969ae-4dc2-445f-98be-e7d764e3df2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:27.066177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4a2969ae-4dc2-445f-98be-e7d764e3df2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:27.073099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a2969ae-4dc2-445f-98be-e7d764e3df2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:27.073585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a2969ae-4dc2-445f-98be-e7d764e3df2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:27.074025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a2969ae-4dc2-445f-98be-e7d764e3df2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:27.074751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a2969ae-4dc2-445f-98be-e7d764e3df2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:27.075212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a2969ae-4dc2-445f-98be-e7d764e3df2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:27.075643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4a2969ae-4dc2-445f-98be-e7d764e3df2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:27.104989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4a2969ae-4dc2-445f-98be-e7d764e3df2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045049 Oct 02 01:10:27.105545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 532/1071] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:28.117201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-671facd5-e2bf-45be-8204-45f7936cbdf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:28.119403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-671facd5-e2bf-45be-8204-45f7936cbdf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:28.125708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671facd5-e2bf-45be-8204-45f7936cbdf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.126222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671facd5-e2bf-45be-8204-45f7936cbdf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.126657 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671facd5-e2bf-45be-8204-45f7936cbdf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.127340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671facd5-e2bf-45be-8204-45f7936cbdf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:28.127788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671facd5-e2bf-45be-8204-45f7936cbdf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:28.128207 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671facd5-e2bf-45be-8204-45f7936cbdf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:28.168896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-671facd5-e2bf-45be-8204-45f7936cbdf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055831 Oct 02 01:10:28.169475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 540/1072] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:29.181955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-237f6599-01cd-4785-b42c-c64752a31210 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:29.184158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-237f6599-01cd-4785-b42c-c64752a31210 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:29.190348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-237f6599-01cd-4785-b42c-c64752a31210 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:29.190833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-237f6599-01cd-4785-b42c-c64752a31210 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:29.191270 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-237f6599-01cd-4785-b42c-c64752a31210 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:29.191956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-237f6599-01cd-4785-b42c-c64752a31210 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:29.192408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-237f6599-01cd-4785-b42c-c64752a31210 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:29.192834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-237f6599-01cd-4785-b42c-c64752a31210 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:29.221457 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-237f6599-01cd-4785-b42c-c64752a31210 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Oct 02 01:10:29.221997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 533/1073] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:30.233693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d6e94e3f-fbe8-4195-a6f3-68181c30d89b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:30.235888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d6e94e3f-fbe8-4195-a6f3-68181c30d89b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:30.242529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6e94e3f-fbe8-4195-a6f3-68181c30d89b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.247566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6e94e3f-fbe8-4195-a6f3-68181c30d89b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.248024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6e94e3f-fbe8-4195-a6f3-68181c30d89b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.248730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6e94e3f-fbe8-4195-a6f3-68181c30d89b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:30.249190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6e94e3f-fbe8-4195-a6f3-68181c30d89b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:30.249620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6e94e3f-fbe8-4195-a6f3-68181c30d89b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:30.278315 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d6e94e3f-fbe8-4195-a6f3-68181c30d89b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048509 Oct 02 01:10:30.278863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 541/1074] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:31.291157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d86cea38-807c-44e6-a73d-f7fdc05beb83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:31.293325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d86cea38-807c-44e6-a73d-f7fdc05beb83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:31.295790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:10:31.295937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:10:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments (ip 10.222.0.25) !!! Oct 02 01:10:31.296930 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:10:31.297067 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:10:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments (ip 10.222.0.25) !!! Oct 02 01:10:31.297833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:31.306002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d86cea38-807c-44e6-a73d-f7fdc05beb83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:31.306520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d86cea38-807c-44e6-a73d-f7fdc05beb83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:31.306964 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d86cea38-807c-44e6-a73d-f7fdc05beb83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:31.307668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d86cea38-807c-44e6-a73d-f7fdc05beb83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:31.308124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d86cea38-807c-44e6-a73d-f7fdc05beb83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:31.308553 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d86cea38-807c-44e6-a73d-f7fdc05beb83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:31.338883 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d86cea38-807c-44e6-a73d-f7fdc05beb83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051787 Oct 02 01:10:31.339433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 534/1075] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:32.351650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-231314cc-d887-4bca-bdd5-e59abe5cbf12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:32.354396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-231314cc-d887-4bca-bdd5-e59abe5cbf12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:32.356788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:32.362576 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231314cc-d887-4bca-bdd5-e59abe5cbf12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.363063 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231314cc-d887-4bca-bdd5-e59abe5cbf12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.363504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231314cc-d887-4bca-bdd5-e59abe5cbf12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.364205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231314cc-d887-4bca-bdd5-e59abe5cbf12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:32.364664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231314cc-d887-4bca-bdd5-e59abe5cbf12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:32.365352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231314cc-d887-4bca-bdd5-e59abe5cbf12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:32.369910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:32.395178 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-231314cc-d887-4bca-bdd5-e59abe5cbf12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047771 Oct 02 01:10:32.395730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 542/1076] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:33.407284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5247ebaf-6f9a-4a4e-864a-e56953443996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:33.409350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5247ebaf-6f9a-4a4e-864a-e56953443996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:33.415872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5247ebaf-6f9a-4a4e-864a-e56953443996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.416356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5247ebaf-6f9a-4a4e-864a-e56953443996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.416786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5247ebaf-6f9a-4a4e-864a-e56953443996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.417477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5247ebaf-6f9a-4a4e-864a-e56953443996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:33.417932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5247ebaf-6f9a-4a4e-864a-e56953443996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:33.418386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5247ebaf-6f9a-4a4e-864a-e56953443996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:33.420709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:10:33.448575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5247ebaf-6f9a-4a4e-864a-e56953443996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045435 Oct 02 01:10:33.449123 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 535/1077] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:34.461106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e747011-c625-4676-bc64-d1284265c53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:34.463956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e747011-c625-4676-bc64-d1284265c53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:34.465962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:10:34.466128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:10:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments (ip 10.222.0.25) !!! Oct 02 01:10:34.474199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e747011-c625-4676-bc64-d1284265c53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:34.474687 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e747011-c625-4676-bc64-d1284265c53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:34.475123 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e747011-c625-4676-bc64-d1284265c53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:34.475820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e747011-c625-4676-bc64-d1284265c53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:34.476277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e747011-c625-4676-bc64-d1284265c53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:34.476708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e747011-c625-4676-bc64-d1284265c53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:34.505746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e747011-c625-4676-bc64-d1284265c53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048680 Oct 02 01:10:34.506329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 543/1078] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:35.518608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5db21cd1-99c8-4420-b894-68bc4607431b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:35.520766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5db21cd1-99c8-4420-b894-68bc4607431b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:35.527603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5db21cd1-99c8-4420-b894-68bc4607431b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.528084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5db21cd1-99c8-4420-b894-68bc4607431b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.528515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5db21cd1-99c8-4420-b894-68bc4607431b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:35.529220 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5db21cd1-99c8-4420-b894-68bc4607431b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:35.529668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5db21cd1-99c8-4420-b894-68bc4607431b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:35.530129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5db21cd1-99c8-4420-b894-68bc4607431b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:35.558692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5db21cd1-99c8-4420-b894-68bc4607431b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 Oct 02 01:10:35.559252 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 536/1079] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:36.571487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bbaf258-9213-4166-bbf7-0b10bae912d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:36.573638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bbaf258-9213-4166-bbf7-0b10bae912d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:36.580045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbaf258-9213-4166-bbf7-0b10bae912d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:36.580527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbaf258-9213-4166-bbf7-0b10bae912d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:36.580968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbaf258-9213-4166-bbf7-0b10bae912d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:36.581663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbaf258-9213-4166-bbf7-0b10bae912d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:36.582152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbaf258-9213-4166-bbf7-0b10bae912d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:36.582583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbaf258-9213-4166-bbf7-0b10bae912d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:36.611939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bbaf258-9213-4166-bbf7-0b10bae912d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Oct 02 01:10:36.612494 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 544/1080] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:10:37.625075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fb5204f9-7f6c-4cb2-bf5d-25c59e88af2e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:37.627300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fb5204f9-7f6c-4cb2-bf5d-25c59e88af2e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:37.633570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb5204f9-7f6c-4cb2-bf5d-25c59e88af2e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.634709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb5204f9-7f6c-4cb2-bf5d-25c59e88af2e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.635144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb5204f9-7f6c-4cb2-bf5d-25c59e88af2e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.635826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb5204f9-7f6c-4cb2-bf5d-25c59e88af2e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:37.636275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb5204f9-7f6c-4cb2-bf5d-25c59e88af2e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:37.636695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb5204f9-7f6c-4cb2-bf5d-25c59e88af2e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:37.664361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fb5204f9-7f6c-4cb2-bf5d-25c59e88af2e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043229 Oct 02 01:10:37.664898 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 537/1081] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:38.677075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ab6cde6-5f67-4637-a40e-da4e735cafc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:38.679584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ab6cde6-5f67-4637-a40e-da4e735cafc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:38.686136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ab6cde6-5f67-4637-a40e-da4e735cafc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.686624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ab6cde6-5f67-4637-a40e-da4e735cafc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.687057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ab6cde6-5f67-4637-a40e-da4e735cafc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.687760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ab6cde6-5f67-4637-a40e-da4e735cafc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:38.688211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ab6cde6-5f67-4637-a40e-da4e735cafc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:38.688643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ab6cde6-5f67-4637-a40e-da4e735cafc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:38.717487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ab6cde6-5f67-4637-a40e-da4e735cafc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Oct 02 01:10:38.718030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 545/1082] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:39.729934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3412b45c-f9a3-42e8-91f2-9d1478afdf8a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:39.732124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3412b45c-f9a3-42e8-91f2-9d1478afdf8a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:39.738675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3412b45c-f9a3-42e8-91f2-9d1478afdf8a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.739164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3412b45c-f9a3-42e8-91f2-9d1478afdf8a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.739603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3412b45c-f9a3-42e8-91f2-9d1478afdf8a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.740560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3412b45c-f9a3-42e8-91f2-9d1478afdf8a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:39.741019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3412b45c-f9a3-42e8-91f2-9d1478afdf8a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:39.741446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3412b45c-f9a3-42e8-91f2-9d1478afdf8a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:39.770086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3412b45c-f9a3-42e8-91f2-9d1478afdf8a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Oct 02 01:10:39.770640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 538/1083] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:40.782621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-163354c1-4d23-4214-9e6a-27ce449d2e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:40.784828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-163354c1-4d23-4214-9e6a-27ce449d2e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:40.791366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-163354c1-4d23-4214-9e6a-27ce449d2e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.791849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-163354c1-4d23-4214-9e6a-27ce449d2e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.792345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-163354c1-4d23-4214-9e6a-27ce449d2e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.793039 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-163354c1-4d23-4214-9e6a-27ce449d2e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:40.793496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-163354c1-4d23-4214-9e6a-27ce449d2e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:40.793923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-163354c1-4d23-4214-9e6a-27ce449d2e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:40.824211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-163354c1-4d23-4214-9e6a-27ce449d2e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Oct 02 01:10:40.824773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 546/1084] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:41.836648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a5abd43d-ca19-4896-ba68-09da5b971269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:41.839428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a5abd43d-ca19-4896-ba68-09da5b971269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:41.845804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5abd43d-ca19-4896-ba68-09da5b971269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.846324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5abd43d-ca19-4896-ba68-09da5b971269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.846763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5abd43d-ca19-4896-ba68-09da5b971269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:41.847450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5abd43d-ca19-4896-ba68-09da5b971269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:41.847901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5abd43d-ca19-4896-ba68-09da5b971269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:41.848324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5abd43d-ca19-4896-ba68-09da5b971269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:41.877888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a5abd43d-ca19-4896-ba68-09da5b971269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Oct 02 01:10:41.878457 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 539/1085] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:42.890396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d0d2c77-47b8-4241-9e46-d5c953857e85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:42.892544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d0d2c77-47b8-4241-9e46-d5c953857e85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:42.899328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d0d2c77-47b8-4241-9e46-d5c953857e85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.900296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d0d2c77-47b8-4241-9e46-d5c953857e85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.900724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d0d2c77-47b8-4241-9e46-d5c953857e85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.901401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d0d2c77-47b8-4241-9e46-d5c953857e85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:42.901843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d0d2c77-47b8-4241-9e46-d5c953857e85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:42.902291 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d0d2c77-47b8-4241-9e46-d5c953857e85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:42.930791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d0d2c77-47b8-4241-9e46-d5c953857e85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Oct 02 01:10:42.931333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 547/1086] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:43.943382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-058fb62d-1a62-4006-b367-5677e3c38d50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:43.945799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-058fb62d-1a62-4006-b367-5677e3c38d50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:43.952767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-058fb62d-1a62-4006-b367-5677e3c38d50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.953243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-058fb62d-1a62-4006-b367-5677e3c38d50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.953675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-058fb62d-1a62-4006-b367-5677e3c38d50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.954390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-058fb62d-1a62-4006-b367-5677e3c38d50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:43.954841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-058fb62d-1a62-4006-b367-5677e3c38d50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:43.955365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-058fb62d-1a62-4006-b367-5677e3c38d50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:43.984543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-058fb62d-1a62-4006-b367-5677e3c38d50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Oct 02 01:10:43.985104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 540/1087] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:44.997128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c68ce3a9-0601-42de-a8bc-a79e0613b75c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:44.999384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c68ce3a9-0601-42de-a8bc-a79e0613b75c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:45.005733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c68ce3a9-0601-42de-a8bc-a79e0613b75c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:45.006257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c68ce3a9-0601-42de-a8bc-a79e0613b75c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:45.006689 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c68ce3a9-0601-42de-a8bc-a79e0613b75c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:45.007379 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c68ce3a9-0601-42de-a8bc-a79e0613b75c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:45.007834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c68ce3a9-0601-42de-a8bc-a79e0613b75c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:45.008262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c68ce3a9-0601-42de-a8bc-a79e0613b75c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:45.037932 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c68ce3a9-0601-42de-a8bc-a79e0613b75c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Oct 02 01:10:45.038514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 548/1088] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:46.050267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e08d9905-cd8e-4bd4-943c-cd7de5c716a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:46.052448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e08d9905-cd8e-4bd4-943c-cd7de5c716a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:46.059341 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08d9905-cd8e-4bd4-943c-cd7de5c716a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.059825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08d9905-cd8e-4bd4-943c-cd7de5c716a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.060260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08d9905-cd8e-4bd4-943c-cd7de5c716a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.060987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08d9905-cd8e-4bd4-943c-cd7de5c716a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:46.061449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08d9905-cd8e-4bd4-943c-cd7de5c716a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:46.061874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e08d9905-cd8e-4bd4-943c-cd7de5c716a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:46.090673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e08d9905-cd8e-4bd4-943c-cd7de5c716a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Oct 02 01:10:46.091214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 541/1089] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:47.103032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f944f32f-f112-4124-bdeb-fee9868b2245 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:47.105252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f944f32f-f112-4124-bdeb-fee9868b2245 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:47.111882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f944f32f-f112-4124-bdeb-fee9868b2245 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.112366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f944f32f-f112-4124-bdeb-fee9868b2245 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.112801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f944f32f-f112-4124-bdeb-fee9868b2245 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.113530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f944f32f-f112-4124-bdeb-fee9868b2245 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:47.113985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f944f32f-f112-4124-bdeb-fee9868b2245 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:47.114441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f944f32f-f112-4124-bdeb-fee9868b2245 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:47.143418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f944f32f-f112-4124-bdeb-fee9868b2245 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Oct 02 01:10:47.143970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 549/1090] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:48.157188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d0b1e5c5-9522-49a4-b8e6-6e0dc18f8ba4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:48.160197 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d0b1e5c5-9522-49a4-b8e6-6e0dc18f8ba4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:48.167238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0b1e5c5-9522-49a4-b8e6-6e0dc18f8ba4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:48.167715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0b1e5c5-9522-49a4-b8e6-6e0dc18f8ba4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:48.168145 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0b1e5c5-9522-49a4-b8e6-6e0dc18f8ba4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:48.168840 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0b1e5c5-9522-49a4-b8e6-6e0dc18f8ba4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:48.169289 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0b1e5c5-9522-49a4-b8e6-6e0dc18f8ba4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:48.169711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0b1e5c5-9522-49a4-b8e6-6e0dc18f8ba4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:48.197903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d0b1e5c5-9522-49a4-b8e6-6e0dc18f8ba4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045210 Oct 02 01:10:48.198487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 542/1091] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:49.210082 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03122a1a-01b1-458d-b768-e6bdc3c0615a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:49.212257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-03122a1a-01b1-458d-b768-e6bdc3c0615a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:49.218706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03122a1a-01b1-458d-b768-e6bdc3c0615a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.219188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03122a1a-01b1-458d-b768-e6bdc3c0615a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.219623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03122a1a-01b1-458d-b768-e6bdc3c0615a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.220315 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03122a1a-01b1-458d-b768-e6bdc3c0615a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:49.220774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03122a1a-01b1-458d-b768-e6bdc3c0615a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:49.221203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03122a1a-01b1-458d-b768-e6bdc3c0615a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:49.251313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-03122a1a-01b1-458d-b768-e6bdc3c0615a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045210 Oct 02 01:10:49.251884 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 550/1092] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:50.264193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0bf88f89-abf5-4e13-8478-76c22dd1872d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:50.266360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0bf88f89-abf5-4e13-8478-76c22dd1872d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:50.272768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bf88f89-abf5-4e13-8478-76c22dd1872d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.273244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bf88f89-abf5-4e13-8478-76c22dd1872d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.273675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bf88f89-abf5-4e13-8478-76c22dd1872d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.274393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bf88f89-abf5-4e13-8478-76c22dd1872d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:50.275436 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bf88f89-abf5-4e13-8478-76c22dd1872d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:50.275856 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bf88f89-abf5-4e13-8478-76c22dd1872d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:50.304214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0bf88f89-abf5-4e13-8478-76c22dd1872d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Oct 02 01:10:50.304765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 543/1093] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:51.315734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-095ad5c1-51ac-4d49-9b0f-cca9ea48e2a5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:51.317938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-095ad5c1-51ac-4d49-9b0f-cca9ea48e2a5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:51.324516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-095ad5c1-51ac-4d49-9b0f-cca9ea48e2a5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:51.324998 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-095ad5c1-51ac-4d49-9b0f-cca9ea48e2a5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:51.325447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-095ad5c1-51ac-4d49-9b0f-cca9ea48e2a5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:51.326160 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-095ad5c1-51ac-4d49-9b0f-cca9ea48e2a5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:51.326616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-095ad5c1-51ac-4d49-9b0f-cca9ea48e2a5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:51.327043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-095ad5c1-51ac-4d49-9b0f-cca9ea48e2a5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:51.356329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-095ad5c1-51ac-4d49-9b0f-cca9ea48e2a5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044746 Oct 02 01:10:51.356882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 551/1094] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:52.369512 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-747137a1-3e07-436d-9f75-d5d7f87d2508 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:52.371695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-747137a1-3e07-436d-9f75-d5d7f87d2508 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:52.377995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-747137a1-3e07-436d-9f75-d5d7f87d2508 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.378514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-747137a1-3e07-436d-9f75-d5d7f87d2508 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.378950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-747137a1-3e07-436d-9f75-d5d7f87d2508 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.379670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-747137a1-3e07-436d-9f75-d5d7f87d2508 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:52.380125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-747137a1-3e07-436d-9f75-d5d7f87d2508 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:52.380550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-747137a1-3e07-436d-9f75-d5d7f87d2508 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:52.408442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-747137a1-3e07-436d-9f75-d5d7f87d2508 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Oct 02 01:10:52.408977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 544/1095] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:53.419738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61b49d3e-49b3-4135-b5ed-ea61da206df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:53.421909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61b49d3e-49b3-4135-b5ed-ea61da206df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:53.428426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b49d3e-49b3-4135-b5ed-ea61da206df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.428906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b49d3e-49b3-4135-b5ed-ea61da206df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.429344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b49d3e-49b3-4135-b5ed-ea61da206df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.430034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b49d3e-49b3-4135-b5ed-ea61da206df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:53.430522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b49d3e-49b3-4135-b5ed-ea61da206df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:53.431481 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b49d3e-49b3-4135-b5ed-ea61da206df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:53.460360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61b49d3e-49b3-4135-b5ed-ea61da206df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044553 Oct 02 01:10:53.460907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 552/1096] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:10:54.472599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b22cf464-318f-496c-a725-5e496c9dea6f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:54.474777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b22cf464-318f-496c-a725-5e496c9dea6f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:54.481826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b22cf464-318f-496c-a725-5e496c9dea6f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:54.482349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b22cf464-318f-496c-a725-5e496c9dea6f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:54.482790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b22cf464-318f-496c-a725-5e496c9dea6f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:54.483478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b22cf464-318f-496c-a725-5e496c9dea6f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:54.483965 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b22cf464-318f-496c-a725-5e496c9dea6f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:54.484390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b22cf464-318f-496c-a725-5e496c9dea6f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:54.512984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b22cf464-318f-496c-a725-5e496c9dea6f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044290 Oct 02 01:10:54.513523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 545/1097] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:55.525990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d7744c5b-8ff4-4c6a-b240-2460fae5c2d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:55.528465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d7744c5b-8ff4-4c6a-b240-2460fae5c2d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:55.534929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7744c5b-8ff4-4c6a-b240-2460fae5c2d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:55.535402 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7744c5b-8ff4-4c6a-b240-2460fae5c2d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:55.535832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7744c5b-8ff4-4c6a-b240-2460fae5c2d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.536513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7744c5b-8ff4-4c6a-b240-2460fae5c2d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:55.536963 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7744c5b-8ff4-4c6a-b240-2460fae5c2d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:55.537380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7744c5b-8ff4-4c6a-b240-2460fae5c2d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:55.568202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d7744c5b-8ff4-4c6a-b240-2460fae5c2d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Oct 02 01:10:55.568745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 553/1098] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:56.580638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-59a515b5-07d9-4290-87d2-de7ff27b6e46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:56.582844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-59a515b5-07d9-4290-87d2-de7ff27b6e46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:56.589351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59a515b5-07d9-4290-87d2-de7ff27b6e46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.589836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59a515b5-07d9-4290-87d2-de7ff27b6e46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.590300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59a515b5-07d9-4290-87d2-de7ff27b6e46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.590995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59a515b5-07d9-4290-87d2-de7ff27b6e46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:56.591448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59a515b5-07d9-4290-87d2-de7ff27b6e46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:56.591871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-59a515b5-07d9-4290-87d2-de7ff27b6e46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:56.621105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-59a515b5-07d9-4290-87d2-de7ff27b6e46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Oct 02 01:10:56.621655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 546/1099] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:57.633413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72fb4dd0-a025-44ec-8daf-ce884dc97ea3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:57.636148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72fb4dd0-a025-44ec-8daf-ce884dc97ea3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:57.642552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72fb4dd0-a025-44ec-8daf-ce884dc97ea3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.643023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72fb4dd0-a025-44ec-8daf-ce884dc97ea3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.643463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72fb4dd0-a025-44ec-8daf-ce884dc97ea3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.644158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72fb4dd0-a025-44ec-8daf-ce884dc97ea3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:57.644619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72fb4dd0-a025-44ec-8daf-ce884dc97ea3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:57.645048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72fb4dd0-a025-44ec-8daf-ce884dc97ea3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:57.674420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72fb4dd0-a025-44ec-8daf-ce884dc97ea3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044860 Oct 02 01:10:57.674975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 554/1100] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:58.687160 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6e1f6cb8-0282-4304-ad29-8f1eac93ba55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:58.689313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6e1f6cb8-0282-4304-ad29-8f1eac93ba55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:58.695493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e1f6cb8-0282-4304-ad29-8f1eac93ba55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.695997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e1f6cb8-0282-4304-ad29-8f1eac93ba55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.696440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e1f6cb8-0282-4304-ad29-8f1eac93ba55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.697163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e1f6cb8-0282-4304-ad29-8f1eac93ba55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:58.697684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e1f6cb8-0282-4304-ad29-8f1eac93ba55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:58.698158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e1f6cb8-0282-4304-ad29-8f1eac93ba55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:58.726359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6e1f6cb8-0282-4304-ad29-8f1eac93ba55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Oct 02 01:10:58.726909 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 547/1101] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:10:59.738436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-acf49a8c-2333-4d5b-ab21-669e43e3e03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:10:59.740826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-acf49a8c-2333-4d5b-ab21-669e43e3e03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:10:59.747722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf49a8c-2333-4d5b-ab21-669e43e3e03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:59.748197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf49a8c-2333-4d5b-ab21-669e43e3e03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:59.748630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf49a8c-2333-4d5b-ab21-669e43e3e03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:59.749312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf49a8c-2333-4d5b-ab21-669e43e3e03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:10:59.749761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf49a8c-2333-4d5b-ab21-669e43e3e03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:10:59.750221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf49a8c-2333-4d5b-ab21-669e43e3e03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:10:59.778117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-acf49a8c-2333-4d5b-ab21-669e43e3e03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043564 Oct 02 01:10:59.778586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 555/1102] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:10:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:00.790370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e00b3682-2bed-4cab-bc50-5b2cf7304f18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:00.792566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e00b3682-2bed-4cab-bc50-5b2cf7304f18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:00.798945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00b3682-2bed-4cab-bc50-5b2cf7304f18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.799365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00b3682-2bed-4cab-bc50-5b2cf7304f18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.799794 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00b3682-2bed-4cab-bc50-5b2cf7304f18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:00.800483 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00b3682-2bed-4cab-bc50-5b2cf7304f18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:00.800937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00b3682-2bed-4cab-bc50-5b2cf7304f18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:00.801359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e00b3682-2bed-4cab-bc50-5b2cf7304f18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:00.830730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e00b3682-2bed-4cab-bc50-5b2cf7304f18 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Oct 02 01:11:00.831276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 548/1103] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:01.843535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79c92760-b142-422b-ad8a-083727093815 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:01.845619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79c92760-b142-422b-ad8a-083727093815 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:01.852034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79c92760-b142-422b-ad8a-083727093815 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.852510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79c92760-b142-422b-ad8a-083727093815 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.852940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79c92760-b142-422b-ad8a-083727093815 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.854296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79c92760-b142-422b-ad8a-083727093815 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:01.854688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79c92760-b142-422b-ad8a-083727093815 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:01.855114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79c92760-b142-422b-ad8a-083727093815 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:01.884291 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79c92760-b142-422b-ad8a-083727093815 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Oct 02 01:11:01.884837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 556/1104] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:02.896834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7d4a13c0-e48b-4b96-992b-32e99d425a3e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:02.898944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7d4a13c0-e48b-4b96-992b-32e99d425a3e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:02.901872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:02.907338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d4a13c0-e48b-4b96-992b-32e99d425a3e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.907825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d4a13c0-e48b-4b96-992b-32e99d425a3e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.908265 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d4a13c0-e48b-4b96-992b-32e99d425a3e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.908964 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d4a13c0-e48b-4b96-992b-32e99d425a3e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:02.909425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d4a13c0-e48b-4b96-992b-32e99d425a3e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:02.909847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d4a13c0-e48b-4b96-992b-32e99d425a3e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:02.939640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7d4a13c0-e48b-4b96-992b-32e99d425a3e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046856 Oct 02 01:11:02.940190 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 549/1105] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:03.952091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa8f640f-6735-48a4-885a-8dd971c85754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:03.954214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa8f640f-6735-48a4-885a-8dd971c85754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:03.956621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:03.961861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa8f640f-6735-48a4-885a-8dd971c85754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:03.962388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa8f640f-6735-48a4-885a-8dd971c85754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:03.962824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa8f640f-6735-48a4-885a-8dd971c85754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:03.964019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa8f640f-6735-48a4-885a-8dd971c85754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:03.964471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa8f640f-6735-48a4-885a-8dd971c85754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:03.964895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa8f640f-6735-48a4-885a-8dd971c85754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:03.967434 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:03.995396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa8f640f-6735-48a4-885a-8dd971c85754 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047340 Oct 02 01:11:03.995948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 557/1106] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:05.007860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-34906dcf-675c-41f6-a0f7-43e0f53ff72f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:05.010525 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-34906dcf-675c-41f6-a0f7-43e0f53ff72f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:05.016942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34906dcf-675c-41f6-a0f7-43e0f53ff72f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:05.017419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34906dcf-675c-41f6-a0f7-43e0f53ff72f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:05.017854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34906dcf-675c-41f6-a0f7-43e0f53ff72f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:05.018578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34906dcf-675c-41f6-a0f7-43e0f53ff72f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:05.019029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34906dcf-675c-41f6-a0f7-43e0f53ff72f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:05.019450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-34906dcf-675c-41f6-a0f7-43e0f53ff72f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:05.023002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:05.049119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-34906dcf-675c-41f6-a0f7-43e0f53ff72f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Oct 02 01:11:05.049678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 550/1107] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:06.061396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c4a9ca0-459f-4716-8a97-07feaaba4557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:06.063657 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c4a9ca0-459f-4716-8a97-07feaaba4557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:06.070343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4a9ca0-459f-4716-8a97-07feaaba4557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:06.070826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4a9ca0-459f-4716-8a97-07feaaba4557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:06.071259 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4a9ca0-459f-4716-8a97-07feaaba4557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:06.071951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4a9ca0-459f-4716-8a97-07feaaba4557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:06.072411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4a9ca0-459f-4716-8a97-07feaaba4557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:06.072832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4a9ca0-459f-4716-8a97-07feaaba4557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:06.101692 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c4a9ca0-459f-4716-8a97-07feaaba4557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044845 Oct 02 01:11:06.102262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 558/1108] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:07.114818 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2349faf8-080b-4d54-bd72-59bf3b8c366c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:07.117243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2349faf8-080b-4d54-bd72-59bf3b8c366c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:07.123665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2349faf8-080b-4d54-bd72-59bf3b8c366c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:07.124147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2349faf8-080b-4d54-bd72-59bf3b8c366c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:07.124583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2349faf8-080b-4d54-bd72-59bf3b8c366c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:07.125271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2349faf8-080b-4d54-bd72-59bf3b8c366c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:07.125723 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2349faf8-080b-4d54-bd72-59bf3b8c366c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:07.126169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2349faf8-080b-4d54-bd72-59bf3b8c366c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:07.155214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2349faf8-080b-4d54-bd72-59bf3b8c366c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Oct 02 01:11:07.155761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 551/1109] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:08.168060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e69336d6-ebc5-4cb8-ba5e-9b0caac4b072 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:08.170236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e69336d6-ebc5-4cb8-ba5e-9b0caac4b072 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:08.176402 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69336d6-ebc5-4cb8-ba5e-9b0caac4b072 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:08.176880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69336d6-ebc5-4cb8-ba5e-9b0caac4b072 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:08.177314 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69336d6-ebc5-4cb8-ba5e-9b0caac4b072 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:08.177995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69336d6-ebc5-4cb8-ba5e-9b0caac4b072 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:08.178473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69336d6-ebc5-4cb8-ba5e-9b0caac4b072 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:08.178894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69336d6-ebc5-4cb8-ba5e-9b0caac4b072 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:08.209016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e69336d6-ebc5-4cb8-ba5e-9b0caac4b072 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 Oct 02 01:11:08.209604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 559/1110] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:08 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:09.221539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c2d3b71c-e7fb-419a-983a-f65a9bbfd1f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:09.223727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c2d3b71c-e7fb-419a-983a-f65a9bbfd1f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:09.230076 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2d3b71c-e7fb-419a-983a-f65a9bbfd1f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:09.230565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2d3b71c-e7fb-419a-983a-f65a9bbfd1f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:09.231021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2d3b71c-e7fb-419a-983a-f65a9bbfd1f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:09.231708 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2d3b71c-e7fb-419a-983a-f65a9bbfd1f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:09.232156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2d3b71c-e7fb-419a-983a-f65a9bbfd1f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:09.232579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c2d3b71c-e7fb-419a-983a-f65a9bbfd1f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:09.261653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c2d3b71c-e7fb-419a-983a-f65a9bbfd1f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Oct 02 01:11:09.262283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 552/1111] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:10.275154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-934147ca-88f1-438a-ab8d-71ab4bf50dfb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:10.277960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-934147ca-88f1-438a-ab8d-71ab4bf50dfb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:10.284684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934147ca-88f1-438a-ab8d-71ab4bf50dfb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:10.285166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934147ca-88f1-438a-ab8d-71ab4bf50dfb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:10.285602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934147ca-88f1-438a-ab8d-71ab4bf50dfb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:10.286319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934147ca-88f1-438a-ab8d-71ab4bf50dfb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:10.286775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934147ca-88f1-438a-ab8d-71ab4bf50dfb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:10.287204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934147ca-88f1-438a-ab8d-71ab4bf50dfb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:10.316280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-934147ca-88f1-438a-ab8d-71ab4bf50dfb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045186 Oct 02 01:11:10.316839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 560/1112] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:11.328733 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7d1de88e-6e40-4a45-89a8-71c374651c05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:11.330933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7d1de88e-6e40-4a45-89a8-71c374651c05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:11.338209 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d1de88e-6e40-4a45-89a8-71c374651c05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.338647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d1de88e-6e40-4a45-89a8-71c374651c05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.339082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d1de88e-6e40-4a45-89a8-71c374651c05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.339772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d1de88e-6e40-4a45-89a8-71c374651c05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:11.340232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d1de88e-6e40-4a45-89a8-71c374651c05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:11.340657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d1de88e-6e40-4a45-89a8-71c374651c05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:11.370295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7d1de88e-6e40-4a45-89a8-71c374651c05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045539 Oct 02 01:11:11.370857 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 553/1113] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:12.382656 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02aeb7bc-15c9-406a-91fe-6839a6d8057f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:12.384844 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-02aeb7bc-15c9-406a-91fe-6839a6d8057f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:12.391322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02aeb7bc-15c9-406a-91fe-6839a6d8057f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:12.391803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02aeb7bc-15c9-406a-91fe-6839a6d8057f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:12.392241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02aeb7bc-15c9-406a-91fe-6839a6d8057f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:12.392930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02aeb7bc-15c9-406a-91fe-6839a6d8057f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:12.393386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02aeb7bc-15c9-406a-91fe-6839a6d8057f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:12.393811 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02aeb7bc-15c9-406a-91fe-6839a6d8057f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:12.423108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02aeb7bc-15c9-406a-91fe-6839a6d8057f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Oct 02 01:11:12.423648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 561/1114] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:13.434770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aaccb3c5-f7cd-40ca-a7b7-5c5010c6559f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:13.436983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aaccb3c5-f7cd-40ca-a7b7-5c5010c6559f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:13.443424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aaccb3c5-f7cd-40ca-a7b7-5c5010c6559f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:13.443911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aaccb3c5-f7cd-40ca-a7b7-5c5010c6559f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:13.444349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aaccb3c5-f7cd-40ca-a7b7-5c5010c6559f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:13.445043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aaccb3c5-f7cd-40ca-a7b7-5c5010c6559f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:13.445500 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aaccb3c5-f7cd-40ca-a7b7-5c5010c6559f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:13.445930 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aaccb3c5-f7cd-40ca-a7b7-5c5010c6559f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:13.474827 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aaccb3c5-f7cd-40ca-a7b7-5c5010c6559f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044051 Oct 02 01:11:13.475377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 554/1115] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:14.487513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-409ce8fe-c655-45e4-949d-8fc957b68bd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:14.489621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-409ce8fe-c655-45e4-949d-8fc957b68bd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:14.496849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-409ce8fe-c655-45e4-949d-8fc957b68bd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:14.497326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-409ce8fe-c655-45e4-949d-8fc957b68bd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:14.497760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-409ce8fe-c655-45e4-949d-8fc957b68bd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:14.498481 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-409ce8fe-c655-45e4-949d-8fc957b68bd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:14.498935 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-409ce8fe-c655-45e4-949d-8fc957b68bd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:14.499365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-409ce8fe-c655-45e4-949d-8fc957b68bd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:14.527995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-409ce8fe-c655-45e4-949d-8fc957b68bd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Oct 02 01:11:14.528536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 562/1116] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:15.540009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0bac308d-d02f-4d9f-a889-cad2c8b037b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:15.542153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0bac308d-d02f-4d9f-a889-cad2c8b037b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:15.548546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bac308d-d02f-4d9f-a889-cad2c8b037b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.549019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bac308d-d02f-4d9f-a889-cad2c8b037b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.549449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bac308d-d02f-4d9f-a889-cad2c8b037b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.550158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bac308d-d02f-4d9f-a889-cad2c8b037b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:15.550609 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bac308d-d02f-4d9f-a889-cad2c8b037b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:15.551027 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0bac308d-d02f-4d9f-a889-cad2c8b037b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:15.579650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0bac308d-d02f-4d9f-a889-cad2c8b037b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043637 Oct 02 01:11:15.580190 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 555/1117] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:16.594110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a0b37dde-bdfa-4c43-828b-49c164abe8cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:16.596261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0b37dde-bdfa-4c43-828b-49c164abe8cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:16.602676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b37dde-bdfa-4c43-828b-49c164abe8cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:16.603153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b37dde-bdfa-4c43-828b-49c164abe8cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:16.604214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b37dde-bdfa-4c43-828b-49c164abe8cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:16.604903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b37dde-bdfa-4c43-828b-49c164abe8cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:16.605353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b37dde-bdfa-4c43-828b-49c164abe8cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:16.605775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b37dde-bdfa-4c43-828b-49c164abe8cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:16.634258 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a0b37dde-bdfa-4c43-828b-49c164abe8cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045528 Oct 02 01:11:16.634811 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 563/1118] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:17.646461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f86940de-59a5-4160-8b61-30b344e8e3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:17.648640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f86940de-59a5-4160-8b61-30b344e8e3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:17.654932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f86940de-59a5-4160-8b61-30b344e8e3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.655415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f86940de-59a5-4160-8b61-30b344e8e3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.655842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f86940de-59a5-4160-8b61-30b344e8e3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.656525 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f86940de-59a5-4160-8b61-30b344e8e3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:17.657008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f86940de-59a5-4160-8b61-30b344e8e3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:17.657429 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f86940de-59a5-4160-8b61-30b344e8e3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:17.686271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f86940de-59a5-4160-8b61-30b344e8e3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Oct 02 01:11:17.686817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 556/1119] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:18.699119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d56c3522-9b71-4c63-9101-6e05307e9269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:18.701355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d56c3522-9b71-4c63-9101-6e05307e9269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:18.707759 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56c3522-9b71-4c63-9101-6e05307e9269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.708242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56c3522-9b71-4c63-9101-6e05307e9269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.708677 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56c3522-9b71-4c63-9101-6e05307e9269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.709369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56c3522-9b71-4c63-9101-6e05307e9269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:18.709837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56c3522-9b71-4c63-9101-6e05307e9269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:18.710298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56c3522-9b71-4c63-9101-6e05307e9269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:18.739622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d56c3522-9b71-4c63-9101-6e05307e9269 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Oct 02 01:11:18.740426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 564/1120] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:19.752241 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2a5d7e76-fdbd-4b75-b36f-7254542d50ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:19.754474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2a5d7e76-fdbd-4b75-b36f-7254542d50ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:19.761374 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a5d7e76-fdbd-4b75-b36f-7254542d50ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.761851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a5d7e76-fdbd-4b75-b36f-7254542d50ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.762312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a5d7e76-fdbd-4b75-b36f-7254542d50ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.762997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a5d7e76-fdbd-4b75-b36f-7254542d50ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:19.763452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a5d7e76-fdbd-4b75-b36f-7254542d50ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:19.763872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2a5d7e76-fdbd-4b75-b36f-7254542d50ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:19.791935 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2a5d7e76-fdbd-4b75-b36f-7254542d50ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 Oct 02 01:11:19.792414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 557/1121] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:20.803485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a95120a8-41cb-4385-a6c3-06326a91be15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:20.805684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a95120a8-41cb-4385-a6c3-06326a91be15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:20.812075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a95120a8-41cb-4385-a6c3-06326a91be15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:20.812560 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a95120a8-41cb-4385-a6c3-06326a91be15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:20.812995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a95120a8-41cb-4385-a6c3-06326a91be15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:20.813683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a95120a8-41cb-4385-a6c3-06326a91be15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:20.814166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a95120a8-41cb-4385-a6c3-06326a91be15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:20.814594 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a95120a8-41cb-4385-a6c3-06326a91be15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:20.843766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a95120a8-41cb-4385-a6c3-06326a91be15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 Oct 02 01:11:20.844306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 565/1122] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:21.855277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c3854f2f-5ccd-46b0-8e2a-d49f4984d5b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:21.857414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c3854f2f-5ccd-46b0-8e2a-d49f4984d5b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:21.863767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3854f2f-5ccd-46b0-8e2a-d49f4984d5b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:21.864243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3854f2f-5ccd-46b0-8e2a-d49f4984d5b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:21.864670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3854f2f-5ccd-46b0-8e2a-d49f4984d5b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:21.865604 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3854f2f-5ccd-46b0-8e2a-d49f4984d5b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:21.866051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3854f2f-5ccd-46b0-8e2a-d49f4984d5b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:21.866500 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c3854f2f-5ccd-46b0-8e2a-d49f4984d5b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:21.896464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c3854f2f-5ccd-46b0-8e2a-d49f4984d5b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Oct 02 01:11:21.897020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 558/1123] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:22.908926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44a5c19a-907e-41b2-a641-a47dcee0fb26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:22.911119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44a5c19a-907e-41b2-a641-a47dcee0fb26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:22.918117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a5c19a-907e-41b2-a641-a47dcee0fb26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.918596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a5c19a-907e-41b2-a641-a47dcee0fb26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.919024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a5c19a-907e-41b2-a641-a47dcee0fb26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.919709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a5c19a-907e-41b2-a641-a47dcee0fb26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:22.920164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a5c19a-907e-41b2-a641-a47dcee0fb26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:22.920587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44a5c19a-907e-41b2-a641-a47dcee0fb26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:22.948931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44a5c19a-907e-41b2-a641-a47dcee0fb26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 Oct 02 01:11:22.949475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 566/1124] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:23.961310 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3f54fbe8-86f0-44e7-8754-50bf3f1f349e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:23.964027 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3f54fbe8-86f0-44e7-8754-50bf3f1f349e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:23.970410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f54fbe8-86f0-44e7-8754-50bf3f1f349e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:23.970907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f54fbe8-86f0-44e7-8754-50bf3f1f349e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:23.971347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f54fbe8-86f0-44e7-8754-50bf3f1f349e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:23.972071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f54fbe8-86f0-44e7-8754-50bf3f1f349e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:23.972522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f54fbe8-86f0-44e7-8754-50bf3f1f349e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:23.972942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f54fbe8-86f0-44e7-8754-50bf3f1f349e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:24.001887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3f54fbe8-86f0-44e7-8754-50bf3f1f349e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Oct 02 01:11:24.002467 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 559/1125] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:25.014838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11a17964-7f0c-40ae-8f73-7db532d63974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:25.017038 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11a17964-7f0c-40ae-8f73-7db532d63974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:25.023549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11a17964-7f0c-40ae-8f73-7db532d63974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.024022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11a17964-7f0c-40ae-8f73-7db532d63974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.024452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11a17964-7f0c-40ae-8f73-7db532d63974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.025133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11a17964-7f0c-40ae-8f73-7db532d63974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:25.025591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11a17964-7f0c-40ae-8f73-7db532d63974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:25.026018 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11a17964-7f0c-40ae-8f73-7db532d63974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:25.055027 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11a17964-7f0c-40ae-8f73-7db532d63974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Oct 02 01:11:25.055580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 567/1126] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:26.067984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bc2c8d97-be02-4045-ace3-b77bc7e323d9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:26.070149 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bc2c8d97-be02-4045-ace3-b77bc7e323d9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:26.077092 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2c8d97-be02-4045-ace3-b77bc7e323d9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:26.077572 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2c8d97-be02-4045-ace3-b77bc7e323d9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:26.078007 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2c8d97-be02-4045-ace3-b77bc7e323d9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:26.078724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2c8d97-be02-4045-ace3-b77bc7e323d9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:26.079178 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2c8d97-be02-4045-ace3-b77bc7e323d9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:26.079600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2c8d97-be02-4045-ace3-b77bc7e323d9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:26.108427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bc2c8d97-be02-4045-ace3-b77bc7e323d9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Oct 02 01:11:26.108974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 560/1127] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:27.121031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f3201fe-c186-40bf-a206-a41bedd32dd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:27.123287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f3201fe-c186-40bf-a206-a41bedd32dd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:27.129590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f3201fe-c186-40bf-a206-a41bedd32dd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:27.130077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f3201fe-c186-40bf-a206-a41bedd32dd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:27.130516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f3201fe-c186-40bf-a206-a41bedd32dd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:27.131198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f3201fe-c186-40bf-a206-a41bedd32dd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:27.131642 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f3201fe-c186-40bf-a206-a41bedd32dd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:27.132059 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f3201fe-c186-40bf-a206-a41bedd32dd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:27.160955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f3201fe-c186-40bf-a206-a41bedd32dd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Oct 02 01:11:27.161516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 568/1128] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:28.173177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ef90b818-a11b-4c9d-8629-2f8f667aa48f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:28.175358 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ef90b818-a11b-4c9d-8629-2f8f667aa48f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:28.181384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef90b818-a11b-4c9d-8629-2f8f667aa48f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:28.182538 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef90b818-a11b-4c9d-8629-2f8f667aa48f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:28.182994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef90b818-a11b-4c9d-8629-2f8f667aa48f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:28.183819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef90b818-a11b-4c9d-8629-2f8f667aa48f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:28.184311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef90b818-a11b-4c9d-8629-2f8f667aa48f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:28.184737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef90b818-a11b-4c9d-8629-2f8f667aa48f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:28.212754 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ef90b818-a11b-4c9d-8629-2f8f667aa48f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043610 Oct 02 01:11:28.213306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 561/1129] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:29.225594 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aff63bc1-e56d-46d6-b7f1-430c3a41bce0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:29.227799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aff63bc1-e56d-46d6-b7f1-430c3a41bce0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:29.234142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aff63bc1-e56d-46d6-b7f1-430c3a41bce0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:29.234620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aff63bc1-e56d-46d6-b7f1-430c3a41bce0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:29.235057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aff63bc1-e56d-46d6-b7f1-430c3a41bce0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:29.235736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aff63bc1-e56d-46d6-b7f1-430c3a41bce0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:29.236181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aff63bc1-e56d-46d6-b7f1-430c3a41bce0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:29.236602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aff63bc1-e56d-46d6-b7f1-430c3a41bce0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:29.265196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aff63bc1-e56d-46d6-b7f1-430c3a41bce0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043604 Oct 02 01:11:29.265738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 569/1130] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:30.278284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3f567107-a4a0-4cc6-bd11-21a862af5009 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:30.280418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3f567107-a4a0-4cc6-bd11-21a862af5009 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:30.287085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f567107-a4a0-4cc6-bd11-21a862af5009 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:30.287508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f567107-a4a0-4cc6-bd11-21a862af5009 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:30.287944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f567107-a4a0-4cc6-bd11-21a862af5009 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:30.288632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f567107-a4a0-4cc6-bd11-21a862af5009 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:30.289199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f567107-a4a0-4cc6-bd11-21a862af5009 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:30.289622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3f567107-a4a0-4cc6-bd11-21a862af5009 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:30.319083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3f567107-a4a0-4cc6-bd11-21a862af5009 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045309 Oct 02 01:11:30.319635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 562/1131] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:31.331491 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83a4cf7b-d8fe-4bfe-a254-555e120dad0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:31.333613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-83a4cf7b-d8fe-4bfe-a254-555e120dad0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:31.340691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83a4cf7b-d8fe-4bfe-a254-555e120dad0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:31.341198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83a4cf7b-d8fe-4bfe-a254-555e120dad0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:31.341629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83a4cf7b-d8fe-4bfe-a254-555e120dad0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:31.342343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83a4cf7b-d8fe-4bfe-a254-555e120dad0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:31.342792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83a4cf7b-d8fe-4bfe-a254-555e120dad0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:31.343230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83a4cf7b-d8fe-4bfe-a254-555e120dad0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:31.371701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83a4cf7b-d8fe-4bfe-a254-555e120dad0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Oct 02 01:11:31.372246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 570/1132] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:32.383889 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d6e0f4c1-562f-44e1-a7fa-72c07bf84115 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:32.385968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d6e0f4c1-562f-44e1-a7fa-72c07bf84115 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:32.392318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e0f4c1-562f-44e1-a7fa-72c07bf84115 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:32.392796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e0f4c1-562f-44e1-a7fa-72c07bf84115 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:32.393226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e0f4c1-562f-44e1-a7fa-72c07bf84115 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:32.394225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e0f4c1-562f-44e1-a7fa-72c07bf84115 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:32.394678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e0f4c1-562f-44e1-a7fa-72c07bf84115 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:32.395128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6e0f4c1-562f-44e1-a7fa-72c07bf84115 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:32.425060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d6e0f4c1-562f-44e1-a7fa-72c07bf84115 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Oct 02 01:11:32.425633 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 563/1133] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:33.437645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4911b788-d511-4845-859f-3d054c69e63d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:33.439832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4911b788-d511-4845-859f-3d054c69e63d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:33.446160 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4911b788-d511-4845-859f-3d054c69e63d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:33.446636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4911b788-d511-4845-859f-3d054c69e63d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:33.447575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4911b788-d511-4845-859f-3d054c69e63d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:33.448264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4911b788-d511-4845-859f-3d054c69e63d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:33.448711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4911b788-d511-4845-859f-3d054c69e63d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:33.449129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4911b788-d511-4845-859f-3d054c69e63d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:33.478813 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4911b788-d511-4845-859f-3d054c69e63d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045159 Oct 02 01:11:33.479368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 571/1134] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:34.490430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3eb03b60-e893-4ed4-b4a4-1037e3ad3ee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:34.492551 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3eb03b60-e893-4ed4-b4a4-1037e3ad3ee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:34.495485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:34.500983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3eb03b60-e893-4ed4-b4a4-1037e3ad3ee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:34.501472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3eb03b60-e893-4ed4-b4a4-1037e3ad3ee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:34.501902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3eb03b60-e893-4ed4-b4a4-1037e3ad3ee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:34.502625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3eb03b60-e893-4ed4-b4a4-1037e3ad3ee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:34.503075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3eb03b60-e893-4ed4-b4a4-1037e3ad3ee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:34.503493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3eb03b60-e893-4ed4-b4a4-1037e3ad3ee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:34.531751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3eb03b60-e893-4ed4-b4a4-1037e3ad3ee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045494 Oct 02 01:11:34.532288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 564/1135] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:35.544637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4052d098-bb99-4920-b584-7bd4b3eec150 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:35.546842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4052d098-bb99-4920-b584-7bd4b3eec150 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:35.549230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:35.554504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4052d098-bb99-4920-b584-7bd4b3eec150 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:35.555000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4052d098-bb99-4920-b584-7bd4b3eec150 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:35.555441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4052d098-bb99-4920-b584-7bd4b3eec150 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:35.556154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4052d098-bb99-4920-b584-7bd4b3eec150 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:35.556634 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4052d098-bb99-4920-b584-7bd4b3eec150 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:35.557045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4052d098-bb99-4920-b584-7bd4b3eec150 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:35.559641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:35.586335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4052d098-bb99-4920-b584-7bd4b3eec150 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Oct 02 01:11:35.586884 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 572/1136] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:36.598173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-32429408-9780-496a-ad00-4c3a6947a66e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:36.600336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-32429408-9780-496a-ad00-4c3a6947a66e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:36.607420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32429408-9780-496a-ad00-4c3a6947a66e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:36.607899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32429408-9780-496a-ad00-4c3a6947a66e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:36.608329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32429408-9780-496a-ad00-4c3a6947a66e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:36.609017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32429408-9780-496a-ad00-4c3a6947a66e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:36.609472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32429408-9780-496a-ad00-4c3a6947a66e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:36.609897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32429408-9780-496a-ad00-4c3a6947a66e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:36.612246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:11:36.639416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-32429408-9780-496a-ad00-4c3a6947a66e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045136 Oct 02 01:11:36.639960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 565/1137] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:37.652043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7e4289e8-c815-4387-a8a7-17db80c5eb1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:37.654228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7e4289e8-c815-4387-a8a7-17db80c5eb1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:37.660142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e4289e8-c815-4387-a8a7-17db80c5eb1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:37.660616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e4289e8-c815-4387-a8a7-17db80c5eb1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:37.661048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e4289e8-c815-4387-a8a7-17db80c5eb1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:37.661724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e4289e8-c815-4387-a8a7-17db80c5eb1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:37.662198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e4289e8-c815-4387-a8a7-17db80c5eb1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:37.662620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e4289e8-c815-4387-a8a7-17db80c5eb1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:37.690739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7e4289e8-c815-4387-a8a7-17db80c5eb1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042833 Oct 02 01:11:37.691274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 573/1138] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:38.703321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-712266bc-7f46-4bf3-9763-694391bc0850 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:38.705474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-712266bc-7f46-4bf3-9763-694391bc0850 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:38.711830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-712266bc-7f46-4bf3-9763-694391bc0850 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:38.712315 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-712266bc-7f46-4bf3-9763-694391bc0850 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:38.713361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-712266bc-7f46-4bf3-9763-694391bc0850 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:38.714053 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-712266bc-7f46-4bf3-9763-694391bc0850 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:38.714531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-712266bc-7f46-4bf3-9763-694391bc0850 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:38.714959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-712266bc-7f46-4bf3-9763-694391bc0850 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:38.743629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-712266bc-7f46-4bf3-9763-694391bc0850 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Oct 02 01:11:38.744206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 566/1139] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:39.755304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8847eff-b4ab-4af1-b0bc-967d8e73549f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:39.757485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c8847eff-b4ab-4af1-b0bc-967d8e73549f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:39.764341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8847eff-b4ab-4af1-b0bc-967d8e73549f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:39.764817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8847eff-b4ab-4af1-b0bc-967d8e73549f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:39.765244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8847eff-b4ab-4af1-b0bc-967d8e73549f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:39.765924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8847eff-b4ab-4af1-b0bc-967d8e73549f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:39.766398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8847eff-b4ab-4af1-b0bc-967d8e73549f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:39.766819 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8847eff-b4ab-4af1-b0bc-967d8e73549f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:39.795413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8847eff-b4ab-4af1-b0bc-967d8e73549f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Oct 02 01:11:39.795977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 574/1140] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:40.807945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e3e68bd8-6af8-4970-9e73-d3b7ee508c28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:40.810157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e3e68bd8-6af8-4970-9e73-d3b7ee508c28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:40.816493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3e68bd8-6af8-4970-9e73-d3b7ee508c28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:40.816968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3e68bd8-6af8-4970-9e73-d3b7ee508c28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:40.817393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3e68bd8-6af8-4970-9e73-d3b7ee508c28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:40.818096 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3e68bd8-6af8-4970-9e73-d3b7ee508c28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:40.818543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3e68bd8-6af8-4970-9e73-d3b7ee508c28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:40.818960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3e68bd8-6af8-4970-9e73-d3b7ee508c28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:40.847346 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e3e68bd8-6af8-4970-9e73-d3b7ee508c28 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 Oct 02 01:11:40.847884 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 567/1141] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:41.860190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-653c458c-195d-47d1-9476-4e341d994ec7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:41.862366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-653c458c-195d-47d1-9476-4e341d994ec7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:41.869329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-653c458c-195d-47d1-9476-4e341d994ec7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:41.869808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-653c458c-195d-47d1-9476-4e341d994ec7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:41.870860 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-653c458c-195d-47d1-9476-4e341d994ec7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:41.871540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-653c458c-195d-47d1-9476-4e341d994ec7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:41.871989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-653c458c-195d-47d1-9476-4e341d994ec7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:41.872409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-653c458c-195d-47d1-9476-4e341d994ec7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:41.900833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-653c458c-195d-47d1-9476-4e341d994ec7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Oct 02 01:11:41.901375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 575/1142] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:42.913303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-146202f4-195a-4a5c-8962-c8544b3710ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:42.915485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-146202f4-195a-4a5c-8962-c8544b3710ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:42.921920 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-146202f4-195a-4a5c-8962-c8544b3710ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:42.922975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-146202f4-195a-4a5c-8962-c8544b3710ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:42.923413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-146202f4-195a-4a5c-8962-c8544b3710ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:42.924111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-146202f4-195a-4a5c-8962-c8544b3710ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:42.924565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-146202f4-195a-4a5c-8962-c8544b3710ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:42.924993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-146202f4-195a-4a5c-8962-c8544b3710ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:42.954043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-146202f4-195a-4a5c-8962-c8544b3710ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Oct 02 01:11:42.954665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 568/1143] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:43.966443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a6c45bc-45b4-4294-b583-e1a659451691 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:43.968621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a6c45bc-45b4-4294-b583-e1a659451691 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:43.975099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6c45bc-45b4-4294-b583-e1a659451691 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:43.975574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6c45bc-45b4-4294-b583-e1a659451691 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:43.976033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6c45bc-45b4-4294-b583-e1a659451691 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:43.976714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6c45bc-45b4-4294-b583-e1a659451691 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:43.977159 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6c45bc-45b4-4294-b583-e1a659451691 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:43.977574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6c45bc-45b4-4294-b583-e1a659451691 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:44.006730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a6c45bc-45b4-4294-b583-e1a659451691 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Oct 02 01:11:44.007274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 576/1144] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:45.018621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7ee16530-c7e9-415a-b42b-15ea877f5354 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:45.020718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7ee16530-c7e9-415a-b42b-15ea877f5354 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:45.027184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee16530-c7e9-415a-b42b-15ea877f5354 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.027677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee16530-c7e9-415a-b42b-15ea877f5354 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:45.028116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee16530-c7e9-415a-b42b-15ea877f5354 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:45.028816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee16530-c7e9-415a-b42b-15ea877f5354 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:45.029274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee16530-c7e9-415a-b42b-15ea877f5354 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:45.029697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ee16530-c7e9-415a-b42b-15ea877f5354 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:45.058868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7ee16530-c7e9-415a-b42b-15ea877f5354 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Oct 02 01:11:45.059436 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 569/1145] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:46.071640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19e1cf99-a2d9-4d43-9e4f-b045380c81b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:46.073804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19e1cf99-a2d9-4d43-9e4f-b045380c81b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:46.080334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e1cf99-a2d9-4d43-9e4f-b045380c81b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:46.080814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e1cf99-a2d9-4d43-9e4f-b045380c81b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:46.081248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e1cf99-a2d9-4d43-9e4f-b045380c81b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:46.081943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e1cf99-a2d9-4d43-9e4f-b045380c81b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:46.082425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e1cf99-a2d9-4d43-9e4f-b045380c81b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:46.082851 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e1cf99-a2d9-4d43-9e4f-b045380c81b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:46.111337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19e1cf99-a2d9-4d43-9e4f-b045380c81b5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 Oct 02 01:11:46.111877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 577/1146] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:47.124536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ee0fb2e4-cdeb-4545-a5f3-93f82e26a6c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:47.126709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ee0fb2e4-cdeb-4545-a5f3-93f82e26a6c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:47.133127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee0fb2e4-cdeb-4545-a5f3-93f82e26a6c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.133607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee0fb2e4-cdeb-4545-a5f3-93f82e26a6c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.134044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee0fb2e4-cdeb-4545-a5f3-93f82e26a6c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.134752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee0fb2e4-cdeb-4545-a5f3-93f82e26a6c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:47.135206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee0fb2e4-cdeb-4545-a5f3-93f82e26a6c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:47.135633 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ee0fb2e4-cdeb-4545-a5f3-93f82e26a6c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:47.163477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ee0fb2e4-cdeb-4545-a5f3-93f82e26a6c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Oct 02 01:11:47.164017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 570/1147] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:48.176618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f729116b-539c-4f36-9bdd-70a66eeb3bcb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:48.178718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f729116b-539c-4f36-9bdd-70a66eeb3bcb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:48.185073 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f729116b-539c-4f36-9bdd-70a66eeb3bcb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.185561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f729116b-539c-4f36-9bdd-70a66eeb3bcb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.186030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f729116b-539c-4f36-9bdd-70a66eeb3bcb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.186743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f729116b-539c-4f36-9bdd-70a66eeb3bcb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:48.187201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f729116b-539c-4f36-9bdd-70a66eeb3bcb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:48.187633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f729116b-539c-4f36-9bdd-70a66eeb3bcb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:48.215969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f729116b-539c-4f36-9bdd-70a66eeb3bcb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043459 Oct 02 01:11:48.216515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 578/1148] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:49.228890 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b85a296c-c773-4f92-948a-d777b3829ea5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:49.231020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b85a296c-c773-4f92-948a-d777b3829ea5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:49.237897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b85a296c-c773-4f92-948a-d777b3829ea5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:49.238423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b85a296c-c773-4f92-948a-d777b3829ea5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:49.238865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b85a296c-c773-4f92-948a-d777b3829ea5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:49.239563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b85a296c-c773-4f92-948a-d777b3829ea5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:49.240021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b85a296c-c773-4f92-948a-d777b3829ea5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:49.240705 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b85a296c-c773-4f92-948a-d777b3829ea5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:49.269648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b85a296c-c773-4f92-948a-d777b3829ea5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Oct 02 01:11:49.270273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 571/1149] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:50.281449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8812ffd-fdd4-4a10-b9f3-ad6ffaea517b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:50.283725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f8812ffd-fdd4-4a10-b9f3-ad6ffaea517b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:50.290077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8812ffd-fdd4-4a10-b9f3-ad6ffaea517b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:50.290564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8812ffd-fdd4-4a10-b9f3-ad6ffaea517b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:50.290990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8812ffd-fdd4-4a10-b9f3-ad6ffaea517b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:50.291671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8812ffd-fdd4-4a10-b9f3-ad6ffaea517b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:50.292121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8812ffd-fdd4-4a10-b9f3-ad6ffaea517b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:50.292549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8812ffd-fdd4-4a10-b9f3-ad6ffaea517b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:50.321415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f8812ffd-fdd4-4a10-b9f3-ad6ffaea517b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Oct 02 01:11:50.321967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 579/1150] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:51.334102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b367f49c-4a4f-4394-b726-facc77e0db8e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:51.336235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b367f49c-4a4f-4394-b726-facc77e0db8e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:51.343242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b367f49c-4a4f-4394-b726-facc77e0db8e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.343716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b367f49c-4a4f-4394-b726-facc77e0db8e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.344143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b367f49c-4a4f-4394-b726-facc77e0db8e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.344827 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b367f49c-4a4f-4394-b726-facc77e0db8e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:51.345276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b367f49c-4a4f-4394-b726-facc77e0db8e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:51.345696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b367f49c-4a4f-4394-b726-facc77e0db8e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:51.373758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b367f49c-4a4f-4394-b726-facc77e0db8e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 Oct 02 01:11:51.374318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 572/1151] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:52.386452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ec8059b-d046-4d23-8e1d-dd0a4ec164d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:52.389110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ec8059b-d046-4d23-8e1d-dd0a4ec164d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:52.395490 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ec8059b-d046-4d23-8e1d-dd0a4ec164d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:52.395970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ec8059b-d046-4d23-8e1d-dd0a4ec164d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:52.396399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ec8059b-d046-4d23-8e1d-dd0a4ec164d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:52.397083 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ec8059b-d046-4d23-8e1d-dd0a4ec164d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:52.397532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ec8059b-d046-4d23-8e1d-dd0a4ec164d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:52.397953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ec8059b-d046-4d23-8e1d-dd0a4ec164d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:52.428436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ec8059b-d046-4d23-8e1d-dd0a4ec164d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Oct 02 01:11:52.428998 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 580/1152] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:53.441033 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9c6815e1-8b1c-4c99-ac33-a7801b77c3df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:53.443215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9c6815e1-8b1c-4c99-ac33-a7801b77c3df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:53.449538 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c6815e1-8b1c-4c99-ac33-a7801b77c3df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:53.450017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c6815e1-8b1c-4c99-ac33-a7801b77c3df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:53.450483 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c6815e1-8b1c-4c99-ac33-a7801b77c3df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:53.451200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c6815e1-8b1c-4c99-ac33-a7801b77c3df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:53.451695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c6815e1-8b1c-4c99-ac33-a7801b77c3df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:53.452124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c6815e1-8b1c-4c99-ac33-a7801b77c3df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:53.480523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9c6815e1-8b1c-4c99-ac33-a7801b77c3df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043685 Oct 02 01:11:53.481069 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 573/1153] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:11:54.493718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87e023a7-fc0d-40ac-844b-1ab9c530cfc8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:54.495886 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-87e023a7-fc0d-40ac-844b-1ab9c530cfc8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:54.502889 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e023a7-fc0d-40ac-844b-1ab9c530cfc8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.503370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e023a7-fc0d-40ac-844b-1ab9c530cfc8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.503813 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e023a7-fc0d-40ac-844b-1ab9c530cfc8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.504486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e023a7-fc0d-40ac-844b-1ab9c530cfc8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:54.504932 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e023a7-fc0d-40ac-844b-1ab9c530cfc8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:54.505356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e023a7-fc0d-40ac-844b-1ab9c530cfc8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:54.533241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87e023a7-fc0d-40ac-844b-1ab9c530cfc8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Oct 02 01:11:54.533778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 581/1154] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:55.545470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8955695f-baf0-4f01-8bc5-ad2f5d9bb603 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:55.547634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8955695f-baf0-4f01-8bc5-ad2f5d9bb603 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:55.553931 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8955695f-baf0-4f01-8bc5-ad2f5d9bb603 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:55.554445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8955695f-baf0-4f01-8bc5-ad2f5d9bb603 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:55.554879 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8955695f-baf0-4f01-8bc5-ad2f5d9bb603 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.555560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8955695f-baf0-4f01-8bc5-ad2f5d9bb603 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:55.556009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8955695f-baf0-4f01-8bc5-ad2f5d9bb603 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:55.556427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8955695f-baf0-4f01-8bc5-ad2f5d9bb603 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:55.585316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8955695f-baf0-4f01-8bc5-ad2f5d9bb603 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Oct 02 01:11:55.585868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 574/1155] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:11:56.598384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c247283-6612-4667-bc55-a3df0fffa752 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:56.600589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c247283-6612-4667-bc55-a3df0fffa752 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:56.607167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c247283-6612-4667-bc55-a3df0fffa752 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.607651 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c247283-6612-4667-bc55-a3df0fffa752 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.608090 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c247283-6612-4667-bc55-a3df0fffa752 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.608784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c247283-6612-4667-bc55-a3df0fffa752 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:56.609242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c247283-6612-4667-bc55-a3df0fffa752 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:56.609672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c247283-6612-4667-bc55-a3df0fffa752 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:56.638141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c247283-6612-4667-bc55-a3df0fffa752 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043719 Oct 02 01:11:56.639210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 582/1156] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:57.651122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c5ced267-2b77-43fb-92da-77644f1c6a40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:57.653178 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c5ced267-2b77-43fb-92da-77644f1c6a40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:57.660206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5ced267-2b77-43fb-92da-77644f1c6a40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.660684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5ced267-2b77-43fb-92da-77644f1c6a40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.661115 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5ced267-2b77-43fb-92da-77644f1c6a40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.661796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5ced267-2b77-43fb-92da-77644f1c6a40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:57.662274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5ced267-2b77-43fb-92da-77644f1c6a40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:57.662696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5ced267-2b77-43fb-92da-77644f1c6a40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:57.691701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c5ced267-2b77-43fb-92da-77644f1c6a40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Oct 02 01:11:57.692261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 575/1157] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:58.703946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a247c99-bfe3-4d98-aa58-3c480b38ccc9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:58.706176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a247c99-bfe3-4d98-aa58-3c480b38ccc9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:58.712560 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a247c99-bfe3-4d98-aa58-3c480b38ccc9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.713043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a247c99-bfe3-4d98-aa58-3c480b38ccc9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.713479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a247c99-bfe3-4d98-aa58-3c480b38ccc9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.714195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a247c99-bfe3-4d98-aa58-3c480b38ccc9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:58.714650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a247c99-bfe3-4d98-aa58-3c480b38ccc9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:58.715075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a247c99-bfe3-4d98-aa58-3c480b38ccc9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:58.744417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a247c99-bfe3-4d98-aa58-3c480b38ccc9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Oct 02 01:11:58.744959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 583/1158] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:11:59.756818 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9a55d79e-c20b-40c6-be03-18ec460869e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:11:59.758977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9a55d79e-c20b-40c6-be03-18ec460869e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:11:59.765030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a55d79e-c20b-40c6-be03-18ec460869e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.765509 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a55d79e-c20b-40c6-be03-18ec460869e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.765940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a55d79e-c20b-40c6-be03-18ec460869e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.766654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a55d79e-c20b-40c6-be03-18ec460869e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:11:59.767101 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a55d79e-c20b-40c6-be03-18ec460869e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:11:59.767520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a55d79e-c20b-40c6-be03-18ec460869e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:11:59.795772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9a55d79e-c20b-40c6-be03-18ec460869e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042470 Oct 02 01:11:59.796317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 576/1159] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:11:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:00.807861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ce137b2-06eb-4eb6-b4dd-4f92d90ca3ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:00.810045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ce137b2-06eb-4eb6-b4dd-4f92d90ca3ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:00.816476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce137b2-06eb-4eb6-b4dd-4f92d90ca3ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.816962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce137b2-06eb-4eb6-b4dd-4f92d90ca3ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.817400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce137b2-06eb-4eb6-b4dd-4f92d90ca3ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.818112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce137b2-06eb-4eb6-b4dd-4f92d90ca3ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:00.818571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce137b2-06eb-4eb6-b4dd-4f92d90ca3ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:00.818997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce137b2-06eb-4eb6-b4dd-4f92d90ca3ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:00.847503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ce137b2-06eb-4eb6-b4dd-4f92d90ca3ae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043658 Oct 02 01:12:00.848053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 584/1160] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:01.966431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-055aa166-24a5-4588-9d65-914789c0281f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:01.968684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-055aa166-24a5-4588-9d65-914789c0281f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:01.974633 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-055aa166-24a5-4588-9d65-914789c0281f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.975112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-055aa166-24a5-4588-9d65-914789c0281f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.975543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-055aa166-24a5-4588-9d65-914789c0281f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:01.976259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-055aa166-24a5-4588-9d65-914789c0281f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:01.976712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-055aa166-24a5-4588-9d65-914789c0281f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:01.977137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-055aa166-24a5-4588-9d65-914789c0281f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:02.006603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-055aa166-24a5-4588-9d65-914789c0281f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150743 Oct 02 01:12:02.007154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 577/1161] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:03.019991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-115d88c3-61ae-4b8d-bf7e-45992c2c9481 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:03.022162 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-115d88c3-61ae-4b8d-bf7e-45992c2c9481 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:03.028822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-115d88c3-61ae-4b8d-bf7e-45992c2c9481 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:03.029303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-115d88c3-61ae-4b8d-bf7e-45992c2c9481 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:03.029769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-115d88c3-61ae-4b8d-bf7e-45992c2c9481 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:03.030500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-115d88c3-61ae-4b8d-bf7e-45992c2c9481 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:03.030953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-115d88c3-61ae-4b8d-bf7e-45992c2c9481 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:03.031375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-115d88c3-61ae-4b8d-bf7e-45992c2c9481 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:03.059748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-115d88c3-61ae-4b8d-bf7e-45992c2c9481 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Oct 02 01:12:03.060292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 585/1162] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:04.072740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d46fcd01-cbca-4f65-918f-f7bf1d7cfd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:04.074952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d46fcd01-cbca-4f65-918f-f7bf1d7cfd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:04.081297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d46fcd01-cbca-4f65-918f-f7bf1d7cfd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:04.081771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d46fcd01-cbca-4f65-918f-f7bf1d7cfd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:04.082236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d46fcd01-cbca-4f65-918f-f7bf1d7cfd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:04.082919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d46fcd01-cbca-4f65-918f-f7bf1d7cfd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:04.083366 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d46fcd01-cbca-4f65-918f-f7bf1d7cfd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:04.083783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d46fcd01-cbca-4f65-918f-f7bf1d7cfd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:04.111968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d46fcd01-cbca-4f65-918f-f7bf1d7cfd95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043188 Oct 02 01:12:04.112510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 578/1163] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:05.124589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e405d14-f2a1-4ec2-9023-772f697dfae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:05.126777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e405d14-f2a1-4ec2-9023-772f697dfae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:05.133074 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e405d14-f2a1-4ec2-9023-772f697dfae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:05.133555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e405d14-f2a1-4ec2-9023-772f697dfae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:05.133989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e405d14-f2a1-4ec2-9023-772f697dfae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:05.134698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e405d14-f2a1-4ec2-9023-772f697dfae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:05.135147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e405d14-f2a1-4ec2-9023-772f697dfae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:05.135570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e405d14-f2a1-4ec2-9023-772f697dfae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:05.164837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e405d14-f2a1-4ec2-9023-772f697dfae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Oct 02 01:12:05.165382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 586/1164] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:06.177668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-978ad220-0cf8-405a-a72e-9e538805a85e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:06.179767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-978ad220-0cf8-405a-a72e-9e538805a85e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:06.182012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:06.187455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-978ad220-0cf8-405a-a72e-9e538805a85e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:06.187973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-978ad220-0cf8-405a-a72e-9e538805a85e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:06.188448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-978ad220-0cf8-405a-a72e-9e538805a85e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:06.189137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-978ad220-0cf8-405a-a72e-9e538805a85e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:06.189580 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-978ad220-0cf8-405a-a72e-9e538805a85e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:06.190009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-978ad220-0cf8-405a-a72e-9e538805a85e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:06.218835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-978ad220-0cf8-405a-a72e-9e538805a85e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Oct 02 01:12:06.219387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 579/1165] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:07.231226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ffbc666-29ad-4710-8459-e0d12a59ca23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:07.233412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ffbc666-29ad-4710-8459-e0d12a59ca23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:07.236077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:07.241844 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ffbc666-29ad-4710-8459-e0d12a59ca23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:07.242355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ffbc666-29ad-4710-8459-e0d12a59ca23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:07.242791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ffbc666-29ad-4710-8459-e0d12a59ca23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:07.243483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ffbc666-29ad-4710-8459-e0d12a59ca23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:07.243939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ffbc666-29ad-4710-8459-e0d12a59ca23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:07.244366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ffbc666-29ad-4710-8459-e0d12a59ca23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:07.248094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:07.273546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ffbc666-29ad-4710-8459-e0d12a59ca23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046299 Oct 02 01:12:07.274140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 587/1166] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:08.286193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dcc01f7a-c575-4692-8789-084b00bd72ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:08.288401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dcc01f7a-c575-4692-8789-084b00bd72ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:08.295078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcc01f7a-c575-4692-8789-084b00bd72ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:08.295568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcc01f7a-c575-4692-8789-084b00bd72ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:08.296008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcc01f7a-c575-4692-8789-084b00bd72ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:08.296717 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcc01f7a-c575-4692-8789-084b00bd72ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:08.297180 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcc01f7a-c575-4692-8789-084b00bd72ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:08.297610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dcc01f7a-c575-4692-8789-084b00bd72ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:08.301187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:08.327046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dcc01f7a-c575-4692-8789-084b00bd72ab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Oct 02 01:12:08.327599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 580/1167] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:08 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:09.340136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a215c6c-02ff-4b91-9150-a7c71418197d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:09.342306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a215c6c-02ff-4b91-9150-a7c71418197d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:09.349579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a215c6c-02ff-4b91-9150-a7c71418197d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:09.350078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a215c6c-02ff-4b91-9150-a7c71418197d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:09.350523 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a215c6c-02ff-4b91-9150-a7c71418197d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:09.351214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a215c6c-02ff-4b91-9150-a7c71418197d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:09.351662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a215c6c-02ff-4b91-9150-a7c71418197d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:09.352193 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a215c6c-02ff-4b91-9150-a7c71418197d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:09.380352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a215c6c-02ff-4b91-9150-a7c71418197d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Oct 02 01:12:09.380900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 588/1168] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:10.392706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-486fa970-10c4-49cb-bdd6-bcc3d7125884 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:10.394872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-486fa970-10c4-49cb-bdd6-bcc3d7125884 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:10.401125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-486fa970-10c4-49cb-bdd6-bcc3d7125884 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:10.401605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-486fa970-10c4-49cb-bdd6-bcc3d7125884 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:10.402034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-486fa970-10c4-49cb-bdd6-bcc3d7125884 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:10.402740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-486fa970-10c4-49cb-bdd6-bcc3d7125884 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:10.403188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-486fa970-10c4-49cb-bdd6-bcc3d7125884 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:10.403609 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-486fa970-10c4-49cb-bdd6-bcc3d7125884 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:10.432678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-486fa970-10c4-49cb-bdd6-bcc3d7125884 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Oct 02 01:12:10.433219 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 581/1169] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:11.444921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-768a7dc5-56c1-47db-9f90-25aea9580d52 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:11.447132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-768a7dc5-56c1-47db-9f90-25aea9580d52 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:11.453489 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768a7dc5-56c1-47db-9f90-25aea9580d52 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:11.453967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768a7dc5-56c1-47db-9f90-25aea9580d52 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:11.454430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768a7dc5-56c1-47db-9f90-25aea9580d52 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:11.455116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768a7dc5-56c1-47db-9f90-25aea9580d52 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:11.455567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768a7dc5-56c1-47db-9f90-25aea9580d52 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:11.455989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768a7dc5-56c1-47db-9f90-25aea9580d52 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:11.485723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-768a7dc5-56c1-47db-9f90-25aea9580d52 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Oct 02 01:12:11.486499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 589/1170] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:12.498442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c08caf73-bc46-4cf6-a292-fe2dda865f64 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:12.501251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c08caf73-bc46-4cf6-a292-fe2dda865f64 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:12.508279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c08caf73-bc46-4cf6-a292-fe2dda865f64 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:12.508768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c08caf73-bc46-4cf6-a292-fe2dda865f64 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:12.509209 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c08caf73-bc46-4cf6-a292-fe2dda865f64 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:12.509909 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c08caf73-bc46-4cf6-a292-fe2dda865f64 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:12.510396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c08caf73-bc46-4cf6-a292-fe2dda865f64 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:12.510826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c08caf73-bc46-4cf6-a292-fe2dda865f64 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:12.539581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c08caf73-bc46-4cf6-a292-fe2dda865f64 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045124 Oct 02 01:12:12.540151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 582/1171] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:13.552040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e559776c-14b8-4a72-a244-fafde6dc3a1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:13.554230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e559776c-14b8-4a72-a244-fafde6dc3a1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:13.561103 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e559776c-14b8-4a72-a244-fafde6dc3a1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:13.561584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e559776c-14b8-4a72-a244-fafde6dc3a1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:13.562537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e559776c-14b8-4a72-a244-fafde6dc3a1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:13.563222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e559776c-14b8-4a72-a244-fafde6dc3a1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:13.563672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e559776c-14b8-4a72-a244-fafde6dc3a1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:13.564093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e559776c-14b8-4a72-a244-fafde6dc3a1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:13.593059 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e559776c-14b8-4a72-a244-fafde6dc3a1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Oct 02 01:12:13.593624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 590/1172] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:14.605769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2d6b3971-e3af-4be7-8292-e818a0a10a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:14.607986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2d6b3971-e3af-4be7-8292-e818a0a10a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:14.614465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d6b3971-e3af-4be7-8292-e818a0a10a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:14.614949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d6b3971-e3af-4be7-8292-e818a0a10a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:14.615652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d6b3971-e3af-4be7-8292-e818a0a10a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:14.616348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d6b3971-e3af-4be7-8292-e818a0a10a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:14.616809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d6b3971-e3af-4be7-8292-e818a0a10a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:14.617238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2d6b3971-e3af-4be7-8292-e818a0a10a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:14.646306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2d6b3971-e3af-4be7-8292-e818a0a10a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Oct 02 01:12:14.646858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 583/1173] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:15.659154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6473e039-d35b-47c9-8593-78c34e55bd2f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:15.661313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6473e039-d35b-47c9-8593-78c34e55bd2f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:15.663330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:12:15.663480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments (ip 10.222.0.25) !!! Oct 02 01:12:15.669892 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6473e039-d35b-47c9-8593-78c34e55bd2f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:15.670405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6473e039-d35b-47c9-8593-78c34e55bd2f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:15.670848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6473e039-d35b-47c9-8593-78c34e55bd2f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:15.672197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6473e039-d35b-47c9-8593-78c34e55bd2f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:15.672653 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6473e039-d35b-47c9-8593-78c34e55bd2f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:15.673082 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6473e039-d35b-47c9-8593-78c34e55bd2f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:15.703079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6473e039-d35b-47c9-8593-78c34e55bd2f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048396 Oct 02 01:12:15.703637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 591/1174] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:16.714745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-16902a7b-2c51-4d77-8ae9-7015465e9838 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:16.716868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-16902a7b-2c51-4d77-8ae9-7015465e9838 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:16.723196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-16902a7b-2c51-4d77-8ae9-7015465e9838 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:16.723674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-16902a7b-2c51-4d77-8ae9-7015465e9838 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:16.724104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-16902a7b-2c51-4d77-8ae9-7015465e9838 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:16.724788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-16902a7b-2c51-4d77-8ae9-7015465e9838 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:16.725237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-16902a7b-2c51-4d77-8ae9-7015465e9838 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:16.725655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-16902a7b-2c51-4d77-8ae9-7015465e9838 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:16.754119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-16902a7b-2c51-4d77-8ae9-7015465e9838 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043238 Oct 02 01:12:16.754659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 584/1175] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:17.766233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e607fb8c-f285-4cb1-92bf-3c02fe917c82 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:17.768374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e607fb8c-f285-4cb1-92bf-3c02fe917c82 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:17.774825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e607fb8c-f285-4cb1-92bf-3c02fe917c82 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.775307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e607fb8c-f285-4cb1-92bf-3c02fe917c82 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.775745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e607fb8c-f285-4cb1-92bf-3c02fe917c82 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:17.776436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e607fb8c-f285-4cb1-92bf-3c02fe917c82 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:17.776885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e607fb8c-f285-4cb1-92bf-3c02fe917c82 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:17.777340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e607fb8c-f285-4cb1-92bf-3c02fe917c82 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:17.805789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e607fb8c-f285-4cb1-92bf-3c02fe917c82 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043481 Oct 02 01:12:17.806354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 592/1176] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:18.818703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-326e802d-d539-4402-ad24-62c2a14dc7bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:18.820839 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-326e802d-d539-4402-ad24-62c2a14dc7bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:18.827593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-326e802d-d539-4402-ad24-62c2a14dc7bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:18.828104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-326e802d-d539-4402-ad24-62c2a14dc7bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:18.828541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-326e802d-d539-4402-ad24-62c2a14dc7bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:18.829232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-326e802d-d539-4402-ad24-62c2a14dc7bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:18.829682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-326e802d-d539-4402-ad24-62c2a14dc7bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:18.830134 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-326e802d-d539-4402-ad24-62c2a14dc7bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:18.858827 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-326e802d-d539-4402-ad24-62c2a14dc7bb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Oct 02 01:12:18.860018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 585/1177] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:19.872176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aee91994-2aa7-49a7-b54f-65a8d7c01cf1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:19.874347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aee91994-2aa7-49a7-b54f-65a8d7c01cf1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:19.880707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aee91994-2aa7-49a7-b54f-65a8d7c01cf1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:19.881212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aee91994-2aa7-49a7-b54f-65a8d7c01cf1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:19.881650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aee91994-2aa7-49a7-b54f-65a8d7c01cf1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:19.882428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aee91994-2aa7-49a7-b54f-65a8d7c01cf1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:19.882883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aee91994-2aa7-49a7-b54f-65a8d7c01cf1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:19.883306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aee91994-2aa7-49a7-b54f-65a8d7c01cf1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:19.912558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aee91994-2aa7-49a7-b54f-65a8d7c01cf1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044393 Oct 02 01:12:19.913100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 593/1178] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:20.924735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ce0bd402-3841-40f4-aac2-f385e0fc6faf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:20.926899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ce0bd402-3841-40f4-aac2-f385e0fc6faf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:20.933621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce0bd402-3841-40f4-aac2-f385e0fc6faf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:20.934144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce0bd402-3841-40f4-aac2-f385e0fc6faf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:20.934583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce0bd402-3841-40f4-aac2-f385e0fc6faf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:20.935274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce0bd402-3841-40f4-aac2-f385e0fc6faf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:20.935729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce0bd402-3841-40f4-aac2-f385e0fc6faf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:20.936143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce0bd402-3841-40f4-aac2-f385e0fc6faf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:20.971379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ce0bd402-3841-40f4-aac2-f385e0fc6faf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050500 Oct 02 01:12:20.971941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 586/1179] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:21.983607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9cb4edf8-5df0-4cef-afb8-90345289c247 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:21.986334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9cb4edf8-5df0-4cef-afb8-90345289c247 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:21.992924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cb4edf8-5df0-4cef-afb8-90345289c247 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:21.993399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cb4edf8-5df0-4cef-afb8-90345289c247 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:21.993832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cb4edf8-5df0-4cef-afb8-90345289c247 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:21.994541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cb4edf8-5df0-4cef-afb8-90345289c247 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:21.994988 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cb4edf8-5df0-4cef-afb8-90345289c247 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:21.995407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cb4edf8-5df0-4cef-afb8-90345289c247 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:22.024772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9cb4edf8-5df0-4cef-afb8-90345289c247 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Oct 02 01:12:22.025325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 594/1180] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:23.037073 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-adba2a0d-1ea1-4848-b6ce-aad0d9e55830 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:23.039227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-adba2a0d-1ea1-4848-b6ce-aad0d9e55830 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:23.045524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adba2a0d-1ea1-4848-b6ce-aad0d9e55830 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:23.046002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adba2a0d-1ea1-4848-b6ce-aad0d9e55830 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:23.046959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adba2a0d-1ea1-4848-b6ce-aad0d9e55830 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:23.047641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adba2a0d-1ea1-4848-b6ce-aad0d9e55830 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:23.048088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adba2a0d-1ea1-4848-b6ce-aad0d9e55830 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:23.048509 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-adba2a0d-1ea1-4848-b6ce-aad0d9e55830 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:23.078546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-adba2a0d-1ea1-4848-b6ce-aad0d9e55830 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045424 Oct 02 01:12:23.079054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 587/1181] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:24.091128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93d9e822-3af3-4eb1-b79e-11288e37e7a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:24.093734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-93d9e822-3af3-4eb1-b79e-11288e37e7a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:24.100136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93d9e822-3af3-4eb1-b79e-11288e37e7a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.100614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93d9e822-3af3-4eb1-b79e-11288e37e7a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.101050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93d9e822-3af3-4eb1-b79e-11288e37e7a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.101741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93d9e822-3af3-4eb1-b79e-11288e37e7a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:24.102225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93d9e822-3af3-4eb1-b79e-11288e37e7a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:24.102652 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93d9e822-3af3-4eb1-b79e-11288e37e7a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:24.131629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93d9e822-3af3-4eb1-b79e-11288e37e7a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Oct 02 01:12:24.132171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 595/1182] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:25.143637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-de2a3806-48d8-43e5-b22b-0f1b4fbb3d8c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:25.145782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-de2a3806-48d8-43e5-b22b-0f1b4fbb3d8c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:25.152181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de2a3806-48d8-43e5-b22b-0f1b4fbb3d8c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.152667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de2a3806-48d8-43e5-b22b-0f1b4fbb3d8c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.153106 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de2a3806-48d8-43e5-b22b-0f1b4fbb3d8c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.153802 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de2a3806-48d8-43e5-b22b-0f1b4fbb3d8c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:25.154304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de2a3806-48d8-43e5-b22b-0f1b4fbb3d8c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:25.154843 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de2a3806-48d8-43e5-b22b-0f1b4fbb3d8c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:25.183154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-de2a3806-48d8-43e5-b22b-0f1b4fbb3d8c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Oct 02 01:12:25.183695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 588/1183] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:26.196276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e221a2e9-d77d-4033-b3e7-0843c14bd6a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:26.198407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e221a2e9-d77d-4033-b3e7-0843c14bd6a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:26.205407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e221a2e9-d77d-4033-b3e7-0843c14bd6a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.205893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e221a2e9-d77d-4033-b3e7-0843c14bd6a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.206366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e221a2e9-d77d-4033-b3e7-0843c14bd6a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:26.207063 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e221a2e9-d77d-4033-b3e7-0843c14bd6a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:26.207515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e221a2e9-d77d-4033-b3e7-0843c14bd6a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:26.207942 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e221a2e9-d77d-4033-b3e7-0843c14bd6a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:26.236283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e221a2e9-d77d-4033-b3e7-0843c14bd6a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044072 Oct 02 01:12:26.236829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 596/1184] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:27.247864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e4f931b1-2b08-4b87-bec2-958cbde9cd69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:27.250507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e4f931b1-2b08-4b87-bec2-958cbde9cd69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:27.256915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4f931b1-2b08-4b87-bec2-958cbde9cd69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:27.257391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4f931b1-2b08-4b87-bec2-958cbde9cd69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:27.257819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4f931b1-2b08-4b87-bec2-958cbde9cd69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:27.258528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4f931b1-2b08-4b87-bec2-958cbde9cd69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:27.258974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4f931b1-2b08-4b87-bec2-958cbde9cd69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:27.259391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e4f931b1-2b08-4b87-bec2-958cbde9cd69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:27.287961 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e4f931b1-2b08-4b87-bec2-958cbde9cd69 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Oct 02 01:12:27.288535 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 589/1185] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:28.300412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d25506e9-5c67-4e3f-bdab-4f7f13bf09aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:28.302586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d25506e9-5c67-4e3f-bdab-4f7f13bf09aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:28.309061 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d25506e9-5c67-4e3f-bdab-4f7f13bf09aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.309529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d25506e9-5c67-4e3f-bdab-4f7f13bf09aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.309959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d25506e9-5c67-4e3f-bdab-4f7f13bf09aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.310667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d25506e9-5c67-4e3f-bdab-4f7f13bf09aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:28.311113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d25506e9-5c67-4e3f-bdab-4f7f13bf09aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:28.311532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d25506e9-5c67-4e3f-bdab-4f7f13bf09aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:28.340088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d25506e9-5c67-4e3f-bdab-4f7f13bf09aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Oct 02 01:12:28.340643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 597/1186] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:29.352308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2895c3fd-7a07-4f2d-8449-759f12779d12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:29.354549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2895c3fd-7a07-4f2d-8449-759f12779d12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:29.361359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2895c3fd-7a07-4f2d-8449-759f12779d12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:29.361832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2895c3fd-7a07-4f2d-8449-759f12779d12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:29.362297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2895c3fd-7a07-4f2d-8449-759f12779d12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:29.362979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2895c3fd-7a07-4f2d-8449-759f12779d12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:29.363428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2895c3fd-7a07-4f2d-8449-759f12779d12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:29.363847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2895c3fd-7a07-4f2d-8449-759f12779d12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:29.392182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2895c3fd-7a07-4f2d-8449-759f12779d12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Oct 02 01:12:29.392743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 590/1187] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:30.404622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ea84e03-f813-4c85-a0fb-c67dbefd1647 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:30.406748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ea84e03-f813-4c85-a0fb-c67dbefd1647 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:30.413121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea84e03-f813-4c85-a0fb-c67dbefd1647 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:30.413601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea84e03-f813-4c85-a0fb-c67dbefd1647 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:30.414035 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea84e03-f813-4c85-a0fb-c67dbefd1647 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:30.414748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea84e03-f813-4c85-a0fb-c67dbefd1647 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:30.415200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea84e03-f813-4c85-a0fb-c67dbefd1647 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:30.415623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea84e03-f813-4c85-a0fb-c67dbefd1647 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:30.445184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ea84e03-f813-4c85-a0fb-c67dbefd1647 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Oct 02 01:12:30.445718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 598/1188] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:31.457778 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7adda464-0c11-4765-ac90-767911828f85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:31.459901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7adda464-0c11-4765-ac90-767911828f85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:31.466367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7adda464-0c11-4765-ac90-767911828f85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:31.466845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7adda464-0c11-4765-ac90-767911828f85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:31.467277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7adda464-0c11-4765-ac90-767911828f85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:31.468467 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7adda464-0c11-4765-ac90-767911828f85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:31.468913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7adda464-0c11-4765-ac90-767911828f85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:31.469336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7adda464-0c11-4765-ac90-767911828f85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:31.498313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7adda464-0c11-4765-ac90-767911828f85 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Oct 02 01:12:31.498869 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 591/1189] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:32.510166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aea4adb1-f95f-4893-b7a2-36a73848a27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:32.512341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aea4adb1-f95f-4893-b7a2-36a73848a27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:32.519363 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aea4adb1-f95f-4893-b7a2-36a73848a27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.519850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aea4adb1-f95f-4893-b7a2-36a73848a27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.520283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aea4adb1-f95f-4893-b7a2-36a73848a27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.520975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aea4adb1-f95f-4893-b7a2-36a73848a27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:32.521433 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aea4adb1-f95f-4893-b7a2-36a73848a27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:32.521858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aea4adb1-f95f-4893-b7a2-36a73848a27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:32.550274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aea4adb1-f95f-4893-b7a2-36a73848a27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Oct 02 01:12:32.550813 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 599/1190] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:33.562595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-35630288-607d-4fa1-ac61-57713eba082d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:33.564728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-35630288-607d-4fa1-ac61-57713eba082d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:33.571086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35630288-607d-4fa1-ac61-57713eba082d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.571570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35630288-607d-4fa1-ac61-57713eba082d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.572004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35630288-607d-4fa1-ac61-57713eba082d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.572686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35630288-607d-4fa1-ac61-57713eba082d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:33.573137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35630288-607d-4fa1-ac61-57713eba082d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:33.573561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35630288-607d-4fa1-ac61-57713eba082d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:33.601661 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-35630288-607d-4fa1-ac61-57713eba082d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Oct 02 01:12:33.602236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 592/1191] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:34.614453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66259982-394a-4e7b-be3b-85ccdb960482 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:34.616879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66259982-394a-4e7b-be3b-85ccdb960482 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:34.623304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66259982-394a-4e7b-be3b-85ccdb960482 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.623773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66259982-394a-4e7b-be3b-85ccdb960482 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.624201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66259982-394a-4e7b-be3b-85ccdb960482 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.624879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66259982-394a-4e7b-be3b-85ccdb960482 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:34.625326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66259982-394a-4e7b-be3b-85ccdb960482 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:34.625746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66259982-394a-4e7b-be3b-85ccdb960482 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:34.653446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66259982-394a-4e7b-be3b-85ccdb960482 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042988 Oct 02 01:12:34.653986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 600/1192] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:35.666759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a2465efb-6b1a-4a40-aca5-51b7bbe707da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:35.668883 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a2465efb-6b1a-4a40-aca5-51b7bbe707da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:35.675707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2465efb-6b1a-4a40-aca5-51b7bbe707da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:35.676184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2465efb-6b1a-4a40-aca5-51b7bbe707da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:35.676619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2465efb-6b1a-4a40-aca5-51b7bbe707da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:35.677297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2465efb-6b1a-4a40-aca5-51b7bbe707da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:35.677746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2465efb-6b1a-4a40-aca5-51b7bbe707da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:35.678193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2465efb-6b1a-4a40-aca5-51b7bbe707da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:35.706667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a2465efb-6b1a-4a40-aca5-51b7bbe707da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Oct 02 01:12:35.707204 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 593/1193] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:36.719785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc0be058-13f3-4e59-aa16-53547315b8f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:36.721987 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc0be058-13f3-4e59-aa16-53547315b8f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:36.728091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0be058-13f3-4e59-aa16-53547315b8f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:36.728573 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0be058-13f3-4e59-aa16-53547315b8f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:36.729001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0be058-13f3-4e59-aa16-53547315b8f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.729688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0be058-13f3-4e59-aa16-53547315b8f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:36.730167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0be058-13f3-4e59-aa16-53547315b8f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:36.730593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0be058-13f3-4e59-aa16-53547315b8f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:36.759420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc0be058-13f3-4e59-aa16-53547315b8f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Oct 02 01:12:36.759955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 601/1194] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:37.772121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8757f856-1170-48d3-87d5-6c259af882e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:37.774306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8757f856-1170-48d3-87d5-6c259af882e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:37.776592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:37.781923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8757f856-1170-48d3-87d5-6c259af882e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:37.782428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8757f856-1170-48d3-87d5-6c259af882e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:37.782859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8757f856-1170-48d3-87d5-6c259af882e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:37.783544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8757f856-1170-48d3-87d5-6c259af882e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:37.783992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8757f856-1170-48d3-87d5-6c259af882e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:37.784414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8757f856-1170-48d3-87d5-6c259af882e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:37.813580 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8757f856-1170-48d3-87d5-6c259af882e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Oct 02 01:12:37.814142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 594/1195] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:38.826004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6b15582-8ecb-4e9d-9214-866d6c84a82c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:38.828219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6b15582-8ecb-4e9d-9214-866d6c84a82c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:38.830645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:38.835868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6b15582-8ecb-4e9d-9214-866d6c84a82c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:38.836344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6b15582-8ecb-4e9d-9214-866d6c84a82c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:38.836773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6b15582-8ecb-4e9d-9214-866d6c84a82c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:38.837452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6b15582-8ecb-4e9d-9214-866d6c84a82c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:38.837896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6b15582-8ecb-4e9d-9214-866d6c84a82c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:38.838339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6b15582-8ecb-4e9d-9214-866d6c84a82c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:38.841980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:38.867278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6b15582-8ecb-4e9d-9214-866d6c84a82c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045191 Oct 02 01:12:38.867827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 602/1196] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:39.879261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b609fae7-5aeb-4aaf-a676-76400477022d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:39.881410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b609fae7-5aeb-4aaf-a676-76400477022d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:39.887878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b609fae7-5aeb-4aaf-a676-76400477022d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:39.888364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b609fae7-5aeb-4aaf-a676-76400477022d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:39.888796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b609fae7-5aeb-4aaf-a676-76400477022d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:39.889482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b609fae7-5aeb-4aaf-a676-76400477022d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:39.889933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b609fae7-5aeb-4aaf-a676-76400477022d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:39.890382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b609fae7-5aeb-4aaf-a676-76400477022d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:39.892700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:12:39.919480 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b609fae7-5aeb-4aaf-a676-76400477022d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Oct 02 01:12:39.920037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 595/1197] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:12:40.933449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f09c46c4-8b70-48a7-83f8-65d345d49454 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:40.934710 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f09c46c4-8b70-48a7-83f8-65d345d49454 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:40.941944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09c46c4-8b70-48a7-83f8-65d345d49454 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:40.942460 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09c46c4-8b70-48a7-83f8-65d345d49454 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:40.942965 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09c46c4-8b70-48a7-83f8-65d345d49454 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:40.943663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09c46c4-8b70-48a7-83f8-65d345d49454 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:40.944110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09c46c4-8b70-48a7-83f8-65d345d49454 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:40.944558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09c46c4-8b70-48a7-83f8-65d345d49454 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:40.975814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f09c46c4-8b70-48a7-83f8-65d345d49454 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047203 Oct 02 01:12:40.976396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 603/1198] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:41.988225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3ba5679b-db90-49b7-9cae-8fc16162a592 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:41.990666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3ba5679b-db90-49b7-9cae-8fc16162a592 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:41.997139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ba5679b-db90-49b7-9cae-8fc16162a592 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:41.997621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ba5679b-db90-49b7-9cae-8fc16162a592 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:41.998079 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ba5679b-db90-49b7-9cae-8fc16162a592 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:41.998771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ba5679b-db90-49b7-9cae-8fc16162a592 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:41.999740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ba5679b-db90-49b7-9cae-8fc16162a592 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:42.000158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ba5679b-db90-49b7-9cae-8fc16162a592 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:42.029338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3ba5679b-db90-49b7-9cae-8fc16162a592 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045085 Oct 02 01:12:42.030004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 596/1199] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:43.041973 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80f78e90-a6d4-47eb-b1bc-f13e99c10cec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:43.044444 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80f78e90-a6d4-47eb-b1bc-f13e99c10cec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:43.051542 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f78e90-a6d4-47eb-b1bc-f13e99c10cec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:43.052036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f78e90-a6d4-47eb-b1bc-f13e99c10cec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:43.052475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f78e90-a6d4-47eb-b1bc-f13e99c10cec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:43.053180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f78e90-a6d4-47eb-b1bc-f13e99c10cec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:43.053664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f78e90-a6d4-47eb-b1bc-f13e99c10cec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:43.054126 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f78e90-a6d4-47eb-b1bc-f13e99c10cec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:43.083724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80f78e90-a6d4-47eb-b1bc-f13e99c10cec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045769 Oct 02 01:12:43.084275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 604/1200] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:12:44.095816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d9d373e3-5508-4961-a7bf-bcbe97d5027f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:44.097959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d9d373e3-5508-4961-a7bf-bcbe97d5027f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:44.104297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9d373e3-5508-4961-a7bf-bcbe97d5027f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:44.104775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9d373e3-5508-4961-a7bf-bcbe97d5027f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:44.105212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9d373e3-5508-4961-a7bf-bcbe97d5027f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:44.105901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9d373e3-5508-4961-a7bf-bcbe97d5027f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:44.106382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9d373e3-5508-4961-a7bf-bcbe97d5027f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:44.106807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9d373e3-5508-4961-a7bf-bcbe97d5027f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:44.136808 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d9d373e3-5508-4961-a7bf-bcbe97d5027f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Oct 02 01:12:44.137281 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 597/1201] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:45.148764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-004e6768-39d4-45ac-a2a8-8a710303add7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:45.150981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-004e6768-39d4-45ac-a2a8-8a710303add7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:45.158141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-004e6768-39d4-45ac-a2a8-8a710303add7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:45.158619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-004e6768-39d4-45ac-a2a8-8a710303add7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:45.159077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-004e6768-39d4-45ac-a2a8-8a710303add7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:45.159784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-004e6768-39d4-45ac-a2a8-8a710303add7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:45.160230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-004e6768-39d4-45ac-a2a8-8a710303add7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:45.160655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-004e6768-39d4-45ac-a2a8-8a710303add7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:45.189116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-004e6768-39d4-45ac-a2a8-8a710303add7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Oct 02 01:12:45.189646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 605/1202] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:46.200858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fa2e5910-5d3f-4dba-9273-68a33f3c8174 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:46.203000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fa2e5910-5d3f-4dba-9273-68a33f3c8174 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:46.209356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2e5910-5d3f-4dba-9273-68a33f3c8174 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:46.209826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2e5910-5d3f-4dba-9273-68a33f3c8174 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:46.210289 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2e5910-5d3f-4dba-9273-68a33f3c8174 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:46.210968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2e5910-5d3f-4dba-9273-68a33f3c8174 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:46.211454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2e5910-5d3f-4dba-9273-68a33f3c8174 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:46.211870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fa2e5910-5d3f-4dba-9273-68a33f3c8174 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:46.240147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fa2e5910-5d3f-4dba-9273-68a33f3c8174 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Oct 02 01:12:46.240970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 598/1203] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:47.252634 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2393100-a376-4e4d-8baf-ca3922ca5b32 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:47.254808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a2393100-a376-4e4d-8baf-ca3922ca5b32 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:47.261424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2393100-a376-4e4d-8baf-ca3922ca5b32 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:47.261898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2393100-a376-4e4d-8baf-ca3922ca5b32 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:47.262362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2393100-a376-4e4d-8baf-ca3922ca5b32 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:47.263042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2393100-a376-4e4d-8baf-ca3922ca5b32 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:47.263489 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2393100-a376-4e4d-8baf-ca3922ca5b32 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:47.263908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2393100-a376-4e4d-8baf-ca3922ca5b32 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:47.292482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2393100-a376-4e4d-8baf-ca3922ca5b32 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Oct 02 01:12:47.292949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 606/1204] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:48.305644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4144e720-4c88-441d-abdd-3afce9813f27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:48.307827 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4144e720-4c88-441d-abdd-3afce9813f27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:48.314419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4144e720-4c88-441d-abdd-3afce9813f27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:48.314910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4144e720-4c88-441d-abdd-3afce9813f27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:48.315349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4144e720-4c88-441d-abdd-3afce9813f27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:48.316047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4144e720-4c88-441d-abdd-3afce9813f27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:48.316527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4144e720-4c88-441d-abdd-3afce9813f27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:48.316954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4144e720-4c88-441d-abdd-3afce9813f27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:48.347201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4144e720-4c88-441d-abdd-3afce9813f27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Oct 02 01:12:48.347752 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 599/1205] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:49.359981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1486c0f-a3d9-463b-b2bc-105dcd40049e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:49.362117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1486c0f-a3d9-463b-b2bc-105dcd40049e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:49.368855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1486c0f-a3d9-463b-b2bc-105dcd40049e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:49.369334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1486c0f-a3d9-463b-b2bc-105dcd40049e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:49.369777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1486c0f-a3d9-463b-b2bc-105dcd40049e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:49.370488 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1486c0f-a3d9-463b-b2bc-105dcd40049e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:49.370939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1486c0f-a3d9-463b-b2bc-105dcd40049e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:49.371364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1486c0f-a3d9-463b-b2bc-105dcd40049e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:49.400309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1486c0f-a3d9-463b-b2bc-105dcd40049e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Oct 02 01:12:49.400861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 607/1206] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:50.413411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1c086f2b-86da-4a7d-b762-6631ac4e138a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:50.415504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1c086f2b-86da-4a7d-b762-6631ac4e138a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:50.421989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c086f2b-86da-4a7d-b762-6631ac4e138a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:50.422508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c086f2b-86da-4a7d-b762-6631ac4e138a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:50.422948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c086f2b-86da-4a7d-b762-6631ac4e138a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:50.423684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c086f2b-86da-4a7d-b762-6631ac4e138a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:50.424146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c086f2b-86da-4a7d-b762-6631ac4e138a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:50.424576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c086f2b-86da-4a7d-b762-6631ac4e138a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:50.453885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1c086f2b-86da-4a7d-b762-6631ac4e138a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 Oct 02 01:12:50.454471 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 600/1207] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:51.466771 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77f1b9ce-3171-4b53-b037-a8dcdc321b86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:51.470299 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77f1b9ce-3171-4b53-b037-a8dcdc321b86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:51.472398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:12:51.472578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments (ip 10.222.0.25) !!! Oct 02 01:12:51.479180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f1b9ce-3171-4b53-b037-a8dcdc321b86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:51.479659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f1b9ce-3171-4b53-b037-a8dcdc321b86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:51.480097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f1b9ce-3171-4b53-b037-a8dcdc321b86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:51.480799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f1b9ce-3171-4b53-b037-a8dcdc321b86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:51.481259 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f1b9ce-3171-4b53-b037-a8dcdc321b86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:51.481688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f1b9ce-3171-4b53-b037-a8dcdc321b86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:51.510968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77f1b9ce-3171-4b53-b037-a8dcdc321b86 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048605 Oct 02 01:12:51.511522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 608/1208] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:52.524119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9a071210-ff5f-4411-919e-ee6df1ed4f06 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:52.526315 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9a071210-ff5f-4411-919e-ee6df1ed4f06 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:52.528272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:12:52.528419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:12:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments (ip 10.222.0.25) !!! Oct 02 01:12:52.534962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a071210-ff5f-4411-919e-ee6df1ed4f06 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.535443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a071210-ff5f-4411-919e-ee6df1ed4f06 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.535883 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a071210-ff5f-4411-919e-ee6df1ed4f06 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.536573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a071210-ff5f-4411-919e-ee6df1ed4f06 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:52.537025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a071210-ff5f-4411-919e-ee6df1ed4f06 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:52.537448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9a071210-ff5f-4411-919e-ee6df1ed4f06 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:52.567105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9a071210-ff5f-4411-919e-ee6df1ed4f06 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Oct 02 01:12:52.567661 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 601/1209] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:53.579939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e832652-ef7d-4696-9c27-088f46fbaa7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:53.582153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e832652-ef7d-4696-9c27-088f46fbaa7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:53.588532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e832652-ef7d-4696-9c27-088f46fbaa7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:53.589006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e832652-ef7d-4696-9c27-088f46fbaa7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:53.589438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e832652-ef7d-4696-9c27-088f46fbaa7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:53.590141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e832652-ef7d-4696-9c27-088f46fbaa7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:53.590591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e832652-ef7d-4696-9c27-088f46fbaa7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:53.591013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e832652-ef7d-4696-9c27-088f46fbaa7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:53.619655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e832652-ef7d-4696-9c27-088f46fbaa7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044355 Oct 02 01:12:53.620199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 609/1210] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:54.631421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-785bedd9-b1cd-49e2-a7d2-4b962719e5eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:54.633597 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-785bedd9-b1cd-49e2-a7d2-4b962719e5eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:54.640709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-785bedd9-b1cd-49e2-a7d2-4b962719e5eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:54.641196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-785bedd9-b1cd-49e2-a7d2-4b962719e5eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:54.641635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-785bedd9-b1cd-49e2-a7d2-4b962719e5eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:54.642365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-785bedd9-b1cd-49e2-a7d2-4b962719e5eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:54.642820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-785bedd9-b1cd-49e2-a7d2-4b962719e5eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:54.643248 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-785bedd9-b1cd-49e2-a7d2-4b962719e5eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:54.672616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-785bedd9-b1cd-49e2-a7d2-4b962719e5eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Oct 02 01:12:54.673165 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 602/1211] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:55.684133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-974ebaca-c515-45ec-b4d9-4d803af4b319 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:55.686810 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-974ebaca-c515-45ec-b4d9-4d803af4b319 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:55.693220 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974ebaca-c515-45ec-b4d9-4d803af4b319 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:55.693698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974ebaca-c515-45ec-b4d9-4d803af4b319 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:55.694160 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974ebaca-c515-45ec-b4d9-4d803af4b319 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:55.694868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974ebaca-c515-45ec-b4d9-4d803af4b319 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:55.695318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974ebaca-c515-45ec-b4d9-4d803af4b319 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:55.695740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974ebaca-c515-45ec-b4d9-4d803af4b319 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:55.724551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-974ebaca-c515-45ec-b4d9-4d803af4b319 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044383 Oct 02 01:12:55.725098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 610/1212] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:56.737023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a0624b13-3630-490c-bbf0-56a9bc345796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:56.739241 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a0624b13-3630-490c-bbf0-56a9bc345796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:56.746037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0624b13-3630-490c-bbf0-56a9bc345796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.746565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0624b13-3630-490c-bbf0-56a9bc345796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.747003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0624b13-3630-490c-bbf0-56a9bc345796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.747702 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0624b13-3630-490c-bbf0-56a9bc345796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:56.748157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0624b13-3630-490c-bbf0-56a9bc345796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:56.748583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0624b13-3630-490c-bbf0-56a9bc345796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:56.777796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a0624b13-3630-490c-bbf0-56a9bc345796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Oct 02 01:12:56.778663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 603/1213] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:57.791408 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da79dbe3-a43f-4324-876d-2f64601624af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:57.793579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da79dbe3-a43f-4324-876d-2f64601624af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:57.800343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da79dbe3-a43f-4324-876d-2f64601624af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.800865 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da79dbe3-a43f-4324-876d-2f64601624af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.801311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da79dbe3-a43f-4324-876d-2f64601624af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.802045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da79dbe3-a43f-4324-876d-2f64601624af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:57.802599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da79dbe3-a43f-4324-876d-2f64601624af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:57.803029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da79dbe3-a43f-4324-876d-2f64601624af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:57.832664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da79dbe3-a43f-4324-876d-2f64601624af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Oct 02 01:12:57.833227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 611/1214] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:12:58.846979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a8e21c96-9f07-4e17-b2eb-031bdd019baa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:58.849141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a8e21c96-9f07-4e17-b2eb-031bdd019baa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:58.855128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8e21c96-9f07-4e17-b2eb-031bdd019baa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:58.855658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8e21c96-9f07-4e17-b2eb-031bdd019baa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:58.856088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8e21c96-9f07-4e17-b2eb-031bdd019baa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:58.856779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8e21c96-9f07-4e17-b2eb-031bdd019baa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:58.857237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8e21c96-9f07-4e17-b2eb-031bdd019baa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:58.857667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a8e21c96-9f07-4e17-b2eb-031bdd019baa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:58.886460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a8e21c96-9f07-4e17-b2eb-031bdd019baa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Oct 02 01:12:58.887012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 604/1215] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:12:59.899474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eed8f021-5efd-4e94-94ce-00febedfa03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:12:59.901636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eed8f021-5efd-4e94-94ce-00febedfa03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:12:59.908694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eed8f021-5efd-4e94-94ce-00febedfa03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:59.909175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eed8f021-5efd-4e94-94ce-00febedfa03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:59.909609 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eed8f021-5efd-4e94-94ce-00febedfa03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:59.910331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eed8f021-5efd-4e94-94ce-00febedfa03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:12:59.910785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eed8f021-5efd-4e94-94ce-00febedfa03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:12:59.911219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eed8f021-5efd-4e94-94ce-00febedfa03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:12:59.942509 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eed8f021-5efd-4e94-94ce-00febedfa03e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047012 Oct 02 01:12:59.946463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 612/1216] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:12:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:00.956245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8277367f-d45d-4a79-abcc-afb33889a0b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:00.957799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8277367f-d45d-4a79-abcc-afb33889a0b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:00.964329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8277367f-d45d-4a79-abcc-afb33889a0b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:00.964804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8277367f-d45d-4a79-abcc-afb33889a0b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:00.965238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8277367f-d45d-4a79-abcc-afb33889a0b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:00.965934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8277367f-d45d-4a79-abcc-afb33889a0b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:00.966408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8277367f-d45d-4a79-abcc-afb33889a0b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:00.966829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8277367f-d45d-4a79-abcc-afb33889a0b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:00.995447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8277367f-d45d-4a79-abcc-afb33889a0b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Oct 02 01:13:00.995984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 605/1217] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:02.008290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b419122-e8fa-43db-bb0b-e9d52aedac91 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:02.010491 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b419122-e8fa-43db-bb0b-e9d52aedac91 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:02.017401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b419122-e8fa-43db-bb0b-e9d52aedac91 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:02.017877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b419122-e8fa-43db-bb0b-e9d52aedac91 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:02.018341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b419122-e8fa-43db-bb0b-e9d52aedac91 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:02.019023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b419122-e8fa-43db-bb0b-e9d52aedac91 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:02.019473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b419122-e8fa-43db-bb0b-e9d52aedac91 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:02.019896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b419122-e8fa-43db-bb0b-e9d52aedac91 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:02.049599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b419122-e8fa-43db-bb0b-e9d52aedac91 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Oct 02 01:13:02.050172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 613/1218] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:03.061083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4692e718-7ad6-4739-af8c-5ac0313103fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:03.063251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4692e718-7ad6-4739-af8c-5ac0313103fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:03.069905 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4692e718-7ad6-4739-af8c-5ac0313103fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:03.070411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4692e718-7ad6-4739-af8c-5ac0313103fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:03.070846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4692e718-7ad6-4739-af8c-5ac0313103fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:03.071526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4692e718-7ad6-4739-af8c-5ac0313103fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:03.071975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4692e718-7ad6-4739-af8c-5ac0313103fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:03.072399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4692e718-7ad6-4739-af8c-5ac0313103fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:03.100761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4692e718-7ad6-4739-af8c-5ac0313103fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043616 Oct 02 01:13:03.101294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 606/1219] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:04.113416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60faf87f-082e-4b3b-acb3-409f230fc935 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:04.115928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60faf87f-082e-4b3b-acb3-409f230fc935 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:04.122269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60faf87f-082e-4b3b-acb3-409f230fc935 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:04.122742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60faf87f-082e-4b3b-acb3-409f230fc935 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:04.123782 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60faf87f-082e-4b3b-acb3-409f230fc935 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:04.124483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60faf87f-082e-4b3b-acb3-409f230fc935 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:04.124934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60faf87f-082e-4b3b-acb3-409f230fc935 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:04.125354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60faf87f-082e-4b3b-acb3-409f230fc935 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:04.153196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60faf87f-082e-4b3b-acb3-409f230fc935 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Oct 02 01:13:04.153736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 614/1220] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:05.164743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c6819705-9524-43e4-91c8-76685eb85494 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:05.166955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c6819705-9524-43e4-91c8-76685eb85494 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:05.173267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6819705-9524-43e4-91c8-76685eb85494 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:05.173770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6819705-9524-43e4-91c8-76685eb85494 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:05.174243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6819705-9524-43e4-91c8-76685eb85494 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:05.174931 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6819705-9524-43e4-91c8-76685eb85494 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:05.175389 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6819705-9524-43e4-91c8-76685eb85494 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:05.175814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c6819705-9524-43e4-91c8-76685eb85494 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:05.204979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c6819705-9524-43e4-91c8-76685eb85494 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Oct 02 01:13:05.205526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 607/1221] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:06.216718 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94d0c36f-7c12-4d6f-b0da-0abce09bf700 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:06.219487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-94d0c36f-7c12-4d6f-b0da-0abce09bf700 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:06.225911 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d0c36f-7c12-4d6f-b0da-0abce09bf700 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:06.226427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d0c36f-7c12-4d6f-b0da-0abce09bf700 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:06.226869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d0c36f-7c12-4d6f-b0da-0abce09bf700 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:06.227565 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d0c36f-7c12-4d6f-b0da-0abce09bf700 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:06.228021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d0c36f-7c12-4d6f-b0da-0abce09bf700 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:06.228454 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d0c36f-7c12-4d6f-b0da-0abce09bf700 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:06.258306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94d0c36f-7c12-4d6f-b0da-0abce09bf700 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Oct 02 01:13:06.258863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 615/1222] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:07.270636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8801b2b3-f893-436b-ab06-253f848b377d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:07.272801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8801b2b3-f893-436b-ab06-253f848b377d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:07.279342 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8801b2b3-f893-436b-ab06-253f848b377d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:07.279824 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8801b2b3-f893-436b-ab06-253f848b377d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:07.280265 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8801b2b3-f893-436b-ab06-253f848b377d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:07.280963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8801b2b3-f893-436b-ab06-253f848b377d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:07.281423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8801b2b3-f893-436b-ab06-253f848b377d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:07.281852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8801b2b3-f893-436b-ab06-253f848b377d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:07.310460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8801b2b3-f893-436b-ab06-253f848b377d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Oct 02 01:13:07.311716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 608/1223] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:08.325153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46d30715-f2c5-4627-bd81-7cfb6726d699 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:08.327926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-46d30715-f2c5-4627-bd81-7cfb6726d699 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:08.334054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46d30715-f2c5-4627-bd81-7cfb6726d699 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.334562 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46d30715-f2c5-4627-bd81-7cfb6726d699 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.335003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46d30715-f2c5-4627-bd81-7cfb6726d699 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:08.335691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46d30715-f2c5-4627-bd81-7cfb6726d699 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:08.336142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46d30715-f2c5-4627-bd81-7cfb6726d699 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:08.336567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46d30715-f2c5-4627-bd81-7cfb6726d699 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:08.364667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-46d30715-f2c5-4627-bd81-7cfb6726d699 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Oct 02 01:13:08.365472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 616/1224] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:08 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:09.376859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a6b33873-e2fb-4cef-ad18-ab8ff26770d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:09.379048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a6b33873-e2fb-4cef-ad18-ab8ff26770d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:09.381330 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:09.386775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6b33873-e2fb-4cef-ad18-ab8ff26770d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:09.387263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6b33873-e2fb-4cef-ad18-ab8ff26770d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:09.387702 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6b33873-e2fb-4cef-ad18-ab8ff26770d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:09.388398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6b33873-e2fb-4cef-ad18-ab8ff26770d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:09.389345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6b33873-e2fb-4cef-ad18-ab8ff26770d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:09.389774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6b33873-e2fb-4cef-ad18-ab8ff26770d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:09.419983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a6b33873-e2fb-4cef-ad18-ab8ff26770d8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047126 Oct 02 01:13:09.420559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 609/1225] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:10.432621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e7165d4-e16c-4108-8499-edbaf4042230 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:10.434902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e7165d4-e16c-4108-8499-edbaf4042230 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:10.437311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:10.442452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e7165d4-e16c-4108-8499-edbaf4042230 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:10.442926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e7165d4-e16c-4108-8499-edbaf4042230 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:10.443390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e7165d4-e16c-4108-8499-edbaf4042230 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:10.444073 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e7165d4-e16c-4108-8499-edbaf4042230 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:10.444520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e7165d4-e16c-4108-8499-edbaf4042230 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:10.444939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e7165d4-e16c-4108-8499-edbaf4042230 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:10.447436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:10.474176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e7165d4-e16c-4108-8499-edbaf4042230 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Oct 02 01:13:10.474660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 617/1226] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:11.486605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bc6f5533-e123-4dd2-80f4-ddd77891cd15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:11.488673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bc6f5533-e123-4dd2-80f4-ddd77891cd15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:11.495401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc6f5533-e123-4dd2-80f4-ddd77891cd15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:11.495878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc6f5533-e123-4dd2-80f4-ddd77891cd15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:11.496312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc6f5533-e123-4dd2-80f4-ddd77891cd15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:11.497000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc6f5533-e123-4dd2-80f4-ddd77891cd15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:11.497456 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc6f5533-e123-4dd2-80f4-ddd77891cd15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:11.498405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc6f5533-e123-4dd2-80f4-ddd77891cd15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:11.500742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:11.527839 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bc6f5533-e123-4dd2-80f4-ddd77891cd15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045314 Oct 02 01:13:11.528383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 610/1227] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:12.539866 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c550e55e-6d8f-4af3-b578-896f654fbf11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:12.542023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c550e55e-6d8f-4af3-b578-896f654fbf11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:12.548955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c550e55e-6d8f-4af3-b578-896f654fbf11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:12.549435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c550e55e-6d8f-4af3-b578-896f654fbf11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:12.549871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c550e55e-6d8f-4af3-b578-896f654fbf11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:12.550594 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c550e55e-6d8f-4af3-b578-896f654fbf11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:12.551046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c550e55e-6d8f-4af3-b578-896f654fbf11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:12.551472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c550e55e-6d8f-4af3-b578-896f654fbf11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:12.580289 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c550e55e-6d8f-4af3-b578-896f654fbf11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Oct 02 01:13:12.580828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 618/1228] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:13.591913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-99fa0503-75ee-4c1f-84ea-7d28065c595f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:13.594004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-99fa0503-75ee-4c1f-84ea-7d28065c595f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:13.600411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99fa0503-75ee-4c1f-84ea-7d28065c595f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:13.600893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99fa0503-75ee-4c1f-84ea-7d28065c595f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:13.601330 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99fa0503-75ee-4c1f-84ea-7d28065c595f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:13.602015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99fa0503-75ee-4c1f-84ea-7d28065c595f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:13.602492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99fa0503-75ee-4c1f-84ea-7d28065c595f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:13.602916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-99fa0503-75ee-4c1f-84ea-7d28065c595f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:13.632479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-99fa0503-75ee-4c1f-84ea-7d28065c595f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Oct 02 01:13:13.633049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 611/1229] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:14.645437 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d317f2c7-2dca-4c77-9d52-bbf38538816b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:14.647662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d317f2c7-2dca-4c77-9d52-bbf38538816b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:14.654146 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d317f2c7-2dca-4c77-9d52-bbf38538816b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:14.655202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d317f2c7-2dca-4c77-9d52-bbf38538816b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:14.655638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d317f2c7-2dca-4c77-9d52-bbf38538816b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:14.656341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d317f2c7-2dca-4c77-9d52-bbf38538816b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:14.656793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d317f2c7-2dca-4c77-9d52-bbf38538816b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:14.657343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d317f2c7-2dca-4c77-9d52-bbf38538816b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:14.685893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d317f2c7-2dca-4c77-9d52-bbf38538816b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044449 Oct 02 01:13:14.686479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 619/1230] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:15.698439 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b4a6ed70-0b3c-4e57-8895-c4e69622d974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:15.700503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b4a6ed70-0b3c-4e57-8895-c4e69622d974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:15.706914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4a6ed70-0b3c-4e57-8895-c4e69622d974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:15.707394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4a6ed70-0b3c-4e57-8895-c4e69622d974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:15.707830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4a6ed70-0b3c-4e57-8895-c4e69622d974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:15.708518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4a6ed70-0b3c-4e57-8895-c4e69622d974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:15.708972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4a6ed70-0b3c-4e57-8895-c4e69622d974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:15.709393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4a6ed70-0b3c-4e57-8895-c4e69622d974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:15.738418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b4a6ed70-0b3c-4e57-8895-c4e69622d974 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Oct 02 01:13:15.738960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 612/1231] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:16.751635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18612316-b866-4815-be97-55e6262d708e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:16.753826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18612316-b866-4815-be97-55e6262d708e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:16.760227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18612316-b866-4815-be97-55e6262d708e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:16.760707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18612316-b866-4815-be97-55e6262d708e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:16.761145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18612316-b866-4815-be97-55e6262d708e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:16.761833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18612316-b866-4815-be97-55e6262d708e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:16.762323 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18612316-b866-4815-be97-55e6262d708e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:16.762752 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18612316-b866-4815-be97-55e6262d708e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:16.791648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18612316-b866-4815-be97-55e6262d708e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Oct 02 01:13:16.792196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 620/1232] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:17.804676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dd58df7b-3288-48a8-bab4-f38ac9372e10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:17.806849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dd58df7b-3288-48a8-bab4-f38ac9372e10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:17.813198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd58df7b-3288-48a8-bab4-f38ac9372e10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:17.813667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd58df7b-3288-48a8-bab4-f38ac9372e10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:17.814121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd58df7b-3288-48a8-bab4-f38ac9372e10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:17.814807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd58df7b-3288-48a8-bab4-f38ac9372e10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:17.815250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd58df7b-3288-48a8-bab4-f38ac9372e10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:17.815669 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd58df7b-3288-48a8-bab4-f38ac9372e10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:17.844606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dd58df7b-3288-48a8-bab4-f38ac9372e10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Oct 02 01:13:17.845139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 613/1233] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:18.856628 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-789bb935-7def-4a55-b27d-31a3795d2eca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:18.858820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-789bb935-7def-4a55-b27d-31a3795d2eca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:18.865406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-789bb935-7def-4a55-b27d-31a3795d2eca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:18.865902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-789bb935-7def-4a55-b27d-31a3795d2eca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:18.866368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-789bb935-7def-4a55-b27d-31a3795d2eca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:18.867064 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-789bb935-7def-4a55-b27d-31a3795d2eca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:18.867521 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-789bb935-7def-4a55-b27d-31a3795d2eca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:18.867949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-789bb935-7def-4a55-b27d-31a3795d2eca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:18.898130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-789bb935-7def-4a55-b27d-31a3795d2eca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045435 Oct 02 01:13:18.898683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 621/1234] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:19.911026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2261fcef-565b-4962-9cb0-771b316e59d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:19.913226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2261fcef-565b-4962-9cb0-771b316e59d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:19.919801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2261fcef-565b-4962-9cb0-771b316e59d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:19.920285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2261fcef-565b-4962-9cb0-771b316e59d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:19.920720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2261fcef-565b-4962-9cb0-771b316e59d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:19.921410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2261fcef-565b-4962-9cb0-771b316e59d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:19.921863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2261fcef-565b-4962-9cb0-771b316e59d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:19.922311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2261fcef-565b-4962-9cb0-771b316e59d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:19.950279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2261fcef-565b-4962-9cb0-771b316e59d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 Oct 02 01:13:19.951312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 614/1235] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:20.962799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4efe743-8a04-4e69-acfc-989fcd0732b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:20.964877 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e4efe743-8a04-4e69-acfc-989fcd0732b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:20.971858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4efe743-8a04-4e69-acfc-989fcd0732b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:20.972338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4efe743-8a04-4e69-acfc-989fcd0732b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:20.972774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4efe743-8a04-4e69-acfc-989fcd0732b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:20.973463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4efe743-8a04-4e69-acfc-989fcd0732b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:20.973918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4efe743-8a04-4e69-acfc-989fcd0732b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:20.974378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4efe743-8a04-4e69-acfc-989fcd0732b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:21.003173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4efe743-8a04-4e69-acfc-989fcd0732b6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 Oct 02 01:13:21.003715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 622/1236] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:22.015563 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c5cac019-6c2b-4121-b96d-d13d0d13be3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:22.017699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c5cac019-6c2b-4121-b96d-d13d0d13be3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:22.024146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5cac019-6c2b-4121-b96d-d13d0d13be3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:22.024735 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5cac019-6c2b-4121-b96d-d13d0d13be3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:22.025057 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5cac019-6c2b-4121-b96d-d13d0d13be3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:22.025742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5cac019-6c2b-4121-b96d-d13d0d13be3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:22.026258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5cac019-6c2b-4121-b96d-d13d0d13be3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:22.027047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5cac019-6c2b-4121-b96d-d13d0d13be3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:22.057742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c5cac019-6c2b-4121-b96d-d13d0d13be3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046648 Oct 02 01:13:22.058320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 615/1237] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:23.069844 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e64dc03b-20e7-4e5f-8b7a-3a447ecf8c30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:23.071996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e64dc03b-20e7-4e5f-8b7a-3a447ecf8c30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:23.078585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64dc03b-20e7-4e5f-8b7a-3a447ecf8c30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.079077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64dc03b-20e7-4e5f-8b7a-3a447ecf8c30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.079519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64dc03b-20e7-4e5f-8b7a-3a447ecf8c30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.080221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64dc03b-20e7-4e5f-8b7a-3a447ecf8c30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:23.080682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64dc03b-20e7-4e5f-8b7a-3a447ecf8c30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:23.081114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64dc03b-20e7-4e5f-8b7a-3a447ecf8c30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:23.109906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e64dc03b-20e7-4e5f-8b7a-3a447ecf8c30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Oct 02 01:13:23.110495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 623/1238] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:24.122302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a6e42eed-b159-424d-afcc-6fbe2ab29031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:24.124918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a6e42eed-b159-424d-afcc-6fbe2ab29031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:24.131364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6e42eed-b159-424d-afcc-6fbe2ab29031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.131846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6e42eed-b159-424d-afcc-6fbe2ab29031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.132284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6e42eed-b159-424d-afcc-6fbe2ab29031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.132973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6e42eed-b159-424d-afcc-6fbe2ab29031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:24.133430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6e42eed-b159-424d-afcc-6fbe2ab29031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:24.133888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6e42eed-b159-424d-afcc-6fbe2ab29031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:24.162372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a6e42eed-b159-424d-afcc-6fbe2ab29031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 Oct 02 01:13:24.162912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 616/1239] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:25.174611 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48c9648a-3543-4edc-aa8d-cb71f743b061 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:25.176754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48c9648a-3543-4edc-aa8d-cb71f743b061 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:25.183175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c9648a-3543-4edc-aa8d-cb71f743b061 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:25.183666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c9648a-3543-4edc-aa8d-cb71f743b061 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:25.184100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c9648a-3543-4edc-aa8d-cb71f743b061 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:25.184791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c9648a-3543-4edc-aa8d-cb71f743b061 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:25.185241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c9648a-3543-4edc-aa8d-cb71f743b061 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:25.185667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48c9648a-3543-4edc-aa8d-cb71f743b061 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:25.218431 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48c9648a-3543-4edc-aa8d-cb71f743b061 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048282 Oct 02 01:13:25.218989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 624/1240] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:26.230719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3094345d-f505-4693-8664-3286c44d8c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:26.233428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3094345d-f505-4693-8664-3286c44d8c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:26.239754 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3094345d-f505-4693-8664-3286c44d8c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:26.240490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3094345d-f505-4693-8664-3286c44d8c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:26.240918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3094345d-f505-4693-8664-3286c44d8c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:26.241593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3094345d-f505-4693-8664-3286c44d8c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:26.242040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3094345d-f505-4693-8664-3286c44d8c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:26.242477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3094345d-f505-4693-8664-3286c44d8c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:26.270363 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3094345d-f505-4693-8664-3286c44d8c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043539 Oct 02 01:13:26.270907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 617/1241] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:27.283085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-425d4d0d-32b9-4433-b16a-ff001c307d40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:27.285236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-425d4d0d-32b9-4433-b16a-ff001c307d40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:27.291699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425d4d0d-32b9-4433-b16a-ff001c307d40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:27.292118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425d4d0d-32b9-4433-b16a-ff001c307d40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:27.292553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425d4d0d-32b9-4433-b16a-ff001c307d40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:27.293242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425d4d0d-32b9-4433-b16a-ff001c307d40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:27.293696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425d4d0d-32b9-4433-b16a-ff001c307d40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:27.294151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425d4d0d-32b9-4433-b16a-ff001c307d40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:27.323209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-425d4d0d-32b9-4433-b16a-ff001c307d40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Oct 02 01:13:27.323759 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 625/1242] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:28.335639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-89664e0f-b8a5-4b69-b42e-b7fccf0bce3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:28.338391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-89664e0f-b8a5-4b69-b42e-b7fccf0bce3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:28.344863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89664e0f-b8a5-4b69-b42e-b7fccf0bce3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.345341 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89664e0f-b8a5-4b69-b42e-b7fccf0bce3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.345773 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89664e0f-b8a5-4b69-b42e-b7fccf0bce3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.346492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89664e0f-b8a5-4b69-b42e-b7fccf0bce3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:28.346939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89664e0f-b8a5-4b69-b42e-b7fccf0bce3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:28.347357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89664e0f-b8a5-4b69-b42e-b7fccf0bce3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:28.376083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-89664e0f-b8a5-4b69-b42e-b7fccf0bce3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Oct 02 01:13:28.376630 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 618/1243] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:29.388827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f0acd02-0c41-43ef-8e24-cf7e79e6f463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:29.390985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f0acd02-0c41-43ef-8e24-cf7e79e6f463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:29.397302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f0acd02-0c41-43ef-8e24-cf7e79e6f463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.397778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f0acd02-0c41-43ef-8e24-cf7e79e6f463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.398253 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f0acd02-0c41-43ef-8e24-cf7e79e6f463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.398938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f0acd02-0c41-43ef-8e24-cf7e79e6f463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:29.399387 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f0acd02-0c41-43ef-8e24-cf7e79e6f463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:29.399808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f0acd02-0c41-43ef-8e24-cf7e79e6f463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:29.428871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f0acd02-0c41-43ef-8e24-cf7e79e6f463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Oct 02 01:13:29.429408 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 626/1244] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:30.441887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1f58c0e4-7455-4f23-a02e-f9f9cd479557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:30.443990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1f58c0e4-7455-4f23-a02e-f9f9cd479557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:30.450408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f58c0e4-7455-4f23-a02e-f9f9cd479557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:30.450881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f58c0e4-7455-4f23-a02e-f9f9cd479557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:30.451311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f58c0e4-7455-4f23-a02e-f9f9cd479557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:30.452040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f58c0e4-7455-4f23-a02e-f9f9cd479557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:30.452486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f58c0e4-7455-4f23-a02e-f9f9cd479557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:30.452911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1f58c0e4-7455-4f23-a02e-f9f9cd479557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:30.480718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1f58c0e4-7455-4f23-a02e-f9f9cd479557 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Oct 02 01:13:30.481259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 619/1245] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:31.493912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60440a43-1cb4-445c-ab27-9d481270e98f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:31.496334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60440a43-1cb4-445c-ab27-9d481270e98f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:31.504280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60440a43-1cb4-445c-ab27-9d481270e98f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:31.504788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60440a43-1cb4-445c-ab27-9d481270e98f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:31.505223 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60440a43-1cb4-445c-ab27-9d481270e98f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:31.505920 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60440a43-1cb4-445c-ab27-9d481270e98f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:31.506404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60440a43-1cb4-445c-ab27-9d481270e98f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:31.506858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60440a43-1cb4-445c-ab27-9d481270e98f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:31.537957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60440a43-1cb4-445c-ab27-9d481270e98f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048256 Oct 02 01:13:31.538569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 627/1246] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:32.552306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e9597d40-d962-40bc-8318-2d2d8ea0141f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:32.554491 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e9597d40-d962-40bc-8318-2d2d8ea0141f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:32.561522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9597d40-d962-40bc-8318-2d2d8ea0141f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.562000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9597d40-d962-40bc-8318-2d2d8ea0141f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.562456 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9597d40-d962-40bc-8318-2d2d8ea0141f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:32.563146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9597d40-d962-40bc-8318-2d2d8ea0141f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:32.563595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9597d40-d962-40bc-8318-2d2d8ea0141f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:32.564017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e9597d40-d962-40bc-8318-2d2d8ea0141f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:32.591716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e9597d40-d962-40bc-8318-2d2d8ea0141f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Oct 02 01:13:32.592270 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 620/1247] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:33.604155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e29b784f-c74a-41c1-94ca-ad7e328e3bca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:33.606329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e29b784f-c74a-41c1-94ca-ad7e328e3bca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:33.612612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e29b784f-c74a-41c1-94ca-ad7e328e3bca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.613085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e29b784f-c74a-41c1-94ca-ad7e328e3bca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.613516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e29b784f-c74a-41c1-94ca-ad7e328e3bca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.614292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e29b784f-c74a-41c1-94ca-ad7e328e3bca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:33.614743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e29b784f-c74a-41c1-94ca-ad7e328e3bca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:33.615411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e29b784f-c74a-41c1-94ca-ad7e328e3bca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:33.644292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e29b784f-c74a-41c1-94ca-ad7e328e3bca tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Oct 02 01:13:33.644826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 628/1248] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:34.656996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1fd69a18-6da8-4116-b4b3-3f43404b8092 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:34.659156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1fd69a18-6da8-4116-b4b3-3f43404b8092 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:34.665473 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd69a18-6da8-4116-b4b3-3f43404b8092 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:34.665943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd69a18-6da8-4116-b4b3-3f43404b8092 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:34.666412 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd69a18-6da8-4116-b4b3-3f43404b8092 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:34.667091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd69a18-6da8-4116-b4b3-3f43404b8092 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:34.667537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd69a18-6da8-4116-b4b3-3f43404b8092 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:34.667955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1fd69a18-6da8-4116-b4b3-3f43404b8092 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:34.696405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1fd69a18-6da8-4116-b4b3-3f43404b8092 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Oct 02 01:13:34.696940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 621/1249] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:35.708701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab9947da-edc2-4e55-b8bd-1fcefdc777d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:35.710966 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab9947da-edc2-4e55-b8bd-1fcefdc777d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:35.717349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9947da-edc2-4e55-b8bd-1fcefdc777d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.717831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9947da-edc2-4e55-b8bd-1fcefdc777d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.718306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9947da-edc2-4e55-b8bd-1fcefdc777d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:35.719006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9947da-edc2-4e55-b8bd-1fcefdc777d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:35.719462 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9947da-edc2-4e55-b8bd-1fcefdc777d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:35.719891 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9947da-edc2-4e55-b8bd-1fcefdc777d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:35.749385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab9947da-edc2-4e55-b8bd-1fcefdc777d4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044685 Oct 02 01:13:35.749932 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 629/1250] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:36.761029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-07a136ba-c585-456e-936a-d2a9cc2b4df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:36.763239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-07a136ba-c585-456e-936a-d2a9cc2b4df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:36.770286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07a136ba-c585-456e-936a-d2a9cc2b4df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:36.770771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07a136ba-c585-456e-936a-d2a9cc2b4df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:36.771207 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07a136ba-c585-456e-936a-d2a9cc2b4df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:36.771903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07a136ba-c585-456e-936a-d2a9cc2b4df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:36.772360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07a136ba-c585-456e-936a-d2a9cc2b4df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:36.772793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07a136ba-c585-456e-936a-d2a9cc2b4df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:36.800760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-07a136ba-c585-456e-936a-d2a9cc2b4df1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 Oct 02 01:13:36.801311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 622/1251] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:37.813262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bbe9740c-232e-4c6e-a528-5304ffc00889 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:37.815438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bbe9740c-232e-4c6e-a528-5304ffc00889 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:37.821417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbe9740c-232e-4c6e-a528-5304ffc00889 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:37.821899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbe9740c-232e-4c6e-a528-5304ffc00889 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:37.822369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbe9740c-232e-4c6e-a528-5304ffc00889 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:37.823110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbe9740c-232e-4c6e-a528-5304ffc00889 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:37.823512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbe9740c-232e-4c6e-a528-5304ffc00889 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:37.823938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbe9740c-232e-4c6e-a528-5304ffc00889 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:37.853535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bbe9740c-232e-4c6e-a528-5304ffc00889 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Oct 02 01:13:37.854099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 630/1252] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:38.866316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-29c187b1-841d-4eb3-b84d-d7f82145eebd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:38.868504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-29c187b1-841d-4eb3-b84d-d7f82145eebd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:38.874925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29c187b1-841d-4eb3-b84d-d7f82145eebd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:38.875408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29c187b1-841d-4eb3-b84d-d7f82145eebd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:38.875848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29c187b1-841d-4eb3-b84d-d7f82145eebd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:38.876545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29c187b1-841d-4eb3-b84d-d7f82145eebd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:38.877057 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29c187b1-841d-4eb3-b84d-d7f82145eebd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:38.877489 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29c187b1-841d-4eb3-b84d-d7f82145eebd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:38.907097 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-29c187b1-841d-4eb3-b84d-d7f82145eebd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045085 Oct 02 01:13:38.907660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 623/1253] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:39.919006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2765b923-8264-4d81-b415-2ec453d713a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:39.921257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2765b923-8264-4d81-b415-2ec453d713a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:39.928752 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2765b923-8264-4d81-b415-2ec453d713a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:39.929227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2765b923-8264-4d81-b415-2ec453d713a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:39.929658 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2765b923-8264-4d81-b415-2ec453d713a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:39.930383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2765b923-8264-4d81-b415-2ec453d713a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:39.931004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2765b923-8264-4d81-b415-2ec453d713a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:39.931436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2765b923-8264-4d81-b415-2ec453d713a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:39.960733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2765b923-8264-4d81-b415-2ec453d713a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045642 Oct 02 01:13:39.961281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 631/1254] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:40.973740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-17f73d7b-4ea0-4105-a3f1-9a2932813907 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:40.976125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-17f73d7b-4ea0-4105-a3f1-9a2932813907 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:40.978460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:40.984083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17f73d7b-4ea0-4105-a3f1-9a2932813907 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:40.984568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17f73d7b-4ea0-4105-a3f1-9a2932813907 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:40.985007 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17f73d7b-4ea0-4105-a3f1-9a2932813907 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:40.985704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17f73d7b-4ea0-4105-a3f1-9a2932813907 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:40.986187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17f73d7b-4ea0-4105-a3f1-9a2932813907 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:40.986614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-17f73d7b-4ea0-4105-a3f1-9a2932813907 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:41.015847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-17f73d7b-4ea0-4105-a3f1-9a2932813907 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Oct 02 01:13:41.016432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 624/1255] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:42.028195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6fd0d430-828f-45a8-8dee-c6d94b8329e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:42.030918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6fd0d430-828f-45a8-8dee-c6d94b8329e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:42.033353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:42.038651 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fd0d430-828f-45a8-8dee-c6d94b8329e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:42.039141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fd0d430-828f-45a8-8dee-c6d94b8329e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:42.039579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fd0d430-828f-45a8-8dee-c6d94b8329e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:42.040281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fd0d430-828f-45a8-8dee-c6d94b8329e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:42.040735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fd0d430-828f-45a8-8dee-c6d94b8329e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:42.041162 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fd0d430-828f-45a8-8dee-c6d94b8329e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:42.045661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:42.070925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6fd0d430-828f-45a8-8dee-c6d94b8329e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046715 Oct 02 01:13:42.071487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 632/1256] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:43.083379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-81bf1a7a-844b-46b3-886d-c03212838546 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:43.085543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-81bf1a7a-844b-46b3-886d-c03212838546 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:43.092295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81bf1a7a-844b-46b3-886d-c03212838546 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:43.092769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81bf1a7a-844b-46b3-886d-c03212838546 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:43.093196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81bf1a7a-844b-46b3-886d-c03212838546 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:43.093881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81bf1a7a-844b-46b3-886d-c03212838546 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:43.094346 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81bf1a7a-844b-46b3-886d-c03212838546 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:43.094765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81bf1a7a-844b-46b3-886d-c03212838546 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:43.097052 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:13:43.125668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-81bf1a7a-844b-46b3-886d-c03212838546 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Oct 02 01:13:43.126252 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 625/1257] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:44.138086 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-246a5a60-214c-4463-8f69-eba5f38696f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:44.140817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-246a5a60-214c-4463-8f69-eba5f38696f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:44.147240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-246a5a60-214c-4463-8f69-eba5f38696f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:44.147720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-246a5a60-214c-4463-8f69-eba5f38696f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:44.148154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-246a5a60-214c-4463-8f69-eba5f38696f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:44.148844 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-246a5a60-214c-4463-8f69-eba5f38696f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:44.149305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-246a5a60-214c-4463-8f69-eba5f38696f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:44.149734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-246a5a60-214c-4463-8f69-eba5f38696f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:44.177645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-246a5a60-214c-4463-8f69-eba5f38696f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043522 Oct 02 01:13:44.178213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 633/1258] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:45.190464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a99093d8-db78-4af1-b7bf-b6e6f0c005e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:45.193153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a99093d8-db78-4af1-b7bf-b6e6f0c005e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:45.200540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99093d8-db78-4af1-b7bf-b6e6f0c005e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:45.201639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99093d8-db78-4af1-b7bf-b6e6f0c005e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:45.202378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99093d8-db78-4af1-b7bf-b6e6f0c005e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:45.203065 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99093d8-db78-4af1-b7bf-b6e6f0c005e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:45.203511 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99093d8-db78-4af1-b7bf-b6e6f0c005e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:45.203927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a99093d8-db78-4af1-b7bf-b6e6f0c005e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:45.232075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a99093d8-db78-4af1-b7bf-b6e6f0c005e9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045645 Oct 02 01:13:45.233120 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 626/1259] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:13:46.245120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1ff72ba-c2f2-46d8-8e08-2b73afba22f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:46.247276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1ff72ba-c2f2-46d8-8e08-2b73afba22f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:46.253632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ff72ba-c2f2-46d8-8e08-2b73afba22f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:46.254132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ff72ba-c2f2-46d8-8e08-2b73afba22f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:46.254567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ff72ba-c2f2-46d8-8e08-2b73afba22f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:46.255253 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ff72ba-c2f2-46d8-8e08-2b73afba22f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:46.255700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ff72ba-c2f2-46d8-8e08-2b73afba22f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:46.256118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ff72ba-c2f2-46d8-8e08-2b73afba22f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:46.286038 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1ff72ba-c2f2-46d8-8e08-2b73afba22f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Oct 02 01:13:46.286618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 634/1260] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:47.298468 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eee845ab-7dfa-49eb-bfaa-f74673fe608c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:47.300642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eee845ab-7dfa-49eb-bfaa-f74673fe608c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:47.307367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee845ab-7dfa-49eb-bfaa-f74673fe608c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:47.307865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee845ab-7dfa-49eb-bfaa-f74673fe608c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:47.308302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee845ab-7dfa-49eb-bfaa-f74673fe608c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:47.309001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee845ab-7dfa-49eb-bfaa-f74673fe608c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:47.309454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee845ab-7dfa-49eb-bfaa-f74673fe608c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:47.309876 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eee845ab-7dfa-49eb-bfaa-f74673fe608c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:47.339787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eee845ab-7dfa-49eb-bfaa-f74673fe608c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045307 Oct 02 01:13:47.340341 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 627/1261] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:48.351951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2a29e77-4f14-4dc0-baef-658b6587e793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:48.354125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e2a29e77-4f14-4dc0-baef-658b6587e793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:48.360436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2a29e77-4f14-4dc0-baef-658b6587e793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.360905 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2a29e77-4f14-4dc0-baef-658b6587e793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.361334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2a29e77-4f14-4dc0-baef-658b6587e793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.362121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2a29e77-4f14-4dc0-baef-658b6587e793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:48.362512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2a29e77-4f14-4dc0-baef-658b6587e793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:48.362931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2a29e77-4f14-4dc0-baef-658b6587e793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:48.391728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2a29e77-4f14-4dc0-baef-658b6587e793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Oct 02 01:13:48.392272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 635/1262] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:49.403942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-09509155-6aa6-4da3-9ca3-5e9562345709 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:49.406690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-09509155-6aa6-4da3-9ca3-5e9562345709 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:49.413070 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09509155-6aa6-4da3-9ca3-5e9562345709 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:49.413553 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09509155-6aa6-4da3-9ca3-5e9562345709 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:49.413992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09509155-6aa6-4da3-9ca3-5e9562345709 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:49.414747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09509155-6aa6-4da3-9ca3-5e9562345709 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:49.415205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09509155-6aa6-4da3-9ca3-5e9562345709 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:49.415634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-09509155-6aa6-4da3-9ca3-5e9562345709 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:49.444518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-09509155-6aa6-4da3-9ca3-5e9562345709 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Oct 02 01:13:49.445065 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 628/1263] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:50.457042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-501200f0-f2ce-4546-b08d-e22c6a65ce68 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:50.459216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-501200f0-f2ce-4546-b08d-e22c6a65ce68 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:50.465702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-501200f0-f2ce-4546-b08d-e22c6a65ce68 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.466224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-501200f0-f2ce-4546-b08d-e22c6a65ce68 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.466666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-501200f0-f2ce-4546-b08d-e22c6a65ce68 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:50.467360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-501200f0-f2ce-4546-b08d-e22c6a65ce68 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:50.467815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-501200f0-f2ce-4546-b08d-e22c6a65ce68 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:50.468242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-501200f0-f2ce-4546-b08d-e22c6a65ce68 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:50.496990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-501200f0-f2ce-4546-b08d-e22c6a65ce68 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Oct 02 01:13:50.497532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 636/1264] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:51.509854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cf02344d-2653-4eed-9b4f-e2eaa19ed81c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:51.512037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cf02344d-2653-4eed-9b4f-e2eaa19ed81c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:51.518886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02344d-2653-4eed-9b4f-e2eaa19ed81c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:51.519361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02344d-2653-4eed-9b4f-e2eaa19ed81c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:51.519797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02344d-2653-4eed-9b4f-e2eaa19ed81c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:51.520637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02344d-2653-4eed-9b4f-e2eaa19ed81c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:51.521437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02344d-2653-4eed-9b4f-e2eaa19ed81c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:51.522240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02344d-2653-4eed-9b4f-e2eaa19ed81c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:51.551012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cf02344d-2653-4eed-9b4f-e2eaa19ed81c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Oct 02 01:13:51.551561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 629/1265] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:52.563352 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab790315-689c-4db7-a102-576a0610cd49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:52.565497 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab790315-689c-4db7-a102-576a0610cd49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:52.572233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab790315-689c-4db7-a102-576a0610cd49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:52.572719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab790315-689c-4db7-a102-576a0610cd49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:52.573158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab790315-689c-4db7-a102-576a0610cd49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:52.573853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab790315-689c-4db7-a102-576a0610cd49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:52.574331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab790315-689c-4db7-a102-576a0610cd49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:52.574761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab790315-689c-4db7-a102-576a0610cd49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:52.603379 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab790315-689c-4db7-a102-576a0610cd49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Oct 02 01:13:52.603926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 637/1266] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:53.615789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b7dd9867-1d5e-443c-98d4-474406c78f17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:53.617933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b7dd9867-1d5e-443c-98d4-474406c78f17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:53.619912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:13:53.620058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments (ip 10.222.0.25) !!! Oct 02 01:13:53.621026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:13:53.621142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments (ip 10.222.0.25) !!! Oct 02 01:13:53.630164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7dd9867-1d5e-443c-98d4-474406c78f17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:53.630648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7dd9867-1d5e-443c-98d4-474406c78f17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:53.631088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7dd9867-1d5e-443c-98d4-474406c78f17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:53.631783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7dd9867-1d5e-443c-98d4-474406c78f17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:53.632236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7dd9867-1d5e-443c-98d4-474406c78f17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:53.632661 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b7dd9867-1d5e-443c-98d4-474406c78f17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:53.661910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b7dd9867-1d5e-443c-98d4-474406c78f17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050245 Oct 02 01:13:53.662500 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 630/1267] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:54.674416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1527565-8e8b-44f6-916c-33caf6c54081 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:54.676550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1527565-8e8b-44f6-916c-33caf6c54081 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:54.682860 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1527565-8e8b-44f6-916c-33caf6c54081 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:54.683339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1527565-8e8b-44f6-916c-33caf6c54081 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:54.683769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1527565-8e8b-44f6-916c-33caf6c54081 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:54.684448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1527565-8e8b-44f6-916c-33caf6c54081 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:54.684894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1527565-8e8b-44f6-916c-33caf6c54081 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:54.685312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1527565-8e8b-44f6-916c-33caf6c54081 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:54.713000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1527565-8e8b-44f6-916c-33caf6c54081 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Oct 02 01:13:54.713533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 638/1268] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:55.725750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6d0fdd23-deea-4614-8c2b-075457b2f904 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:55.727926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6d0fdd23-deea-4614-8c2b-075457b2f904 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:55.734791 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d0fdd23-deea-4614-8c2b-075457b2f904 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:55.735258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d0fdd23-deea-4614-8c2b-075457b2f904 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:55.735684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d0fdd23-deea-4614-8c2b-075457b2f904 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:55.736359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d0fdd23-deea-4614-8c2b-075457b2f904 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:55.736804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d0fdd23-deea-4614-8c2b-075457b2f904 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:55.737219 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6d0fdd23-deea-4614-8c2b-075457b2f904 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:55.765881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6d0fdd23-deea-4614-8c2b-075457b2f904 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Oct 02 01:13:55.766443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 631/1269] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:56.778181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8ca5c71-befb-4565-bed7-8c4170042c23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:56.780370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c8ca5c71-befb-4565-bed7-8c4170042c23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:56.782422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:13:56.782571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments (ip 10.222.0.25) !!! Oct 02 01:13:56.790916 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ca5c71-befb-4565-bed7-8c4170042c23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:56.791406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ca5c71-befb-4565-bed7-8c4170042c23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:56.791846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ca5c71-befb-4565-bed7-8c4170042c23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:56.792551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ca5c71-befb-4565-bed7-8c4170042c23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:56.793008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ca5c71-befb-4565-bed7-8c4170042c23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:56.793439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8ca5c71-befb-4565-bed7-8c4170042c23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:56.823491 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8ca5c71-befb-4565-bed7-8c4170042c23 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049274 Oct 02 01:13:56.824025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 639/1270] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:57.835910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bba9aa0b-8a4e-4e93-b263-484ebcc38e58 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:57.838028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bba9aa0b-8a4e-4e93-b263-484ebcc38e58 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:57.844871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba9aa0b-8a4e-4e93-b263-484ebcc38e58 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:57.845351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba9aa0b-8a4e-4e93-b263-484ebcc38e58 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:57.845779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba9aa0b-8a4e-4e93-b263-484ebcc38e58 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:57.846487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba9aa0b-8a4e-4e93-b263-484ebcc38e58 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:57.846933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba9aa0b-8a4e-4e93-b263-484ebcc38e58 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:57.847351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bba9aa0b-8a4e-4e93-b263-484ebcc38e58 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:57.875881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bba9aa0b-8a4e-4e93-b263-484ebcc38e58 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Oct 02 01:13:57.876420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 632/1271] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:58.888429 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcdf14f7-2c50-47a1-846a-ff588b9617fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:58.890554 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dcdf14f7-2c50-47a1-846a-ff588b9617fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:58.896940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcdf14f7-2c50-47a1-846a-ff588b9617fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:58.897427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcdf14f7-2c50-47a1-846a-ff588b9617fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:58.897870 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcdf14f7-2c50-47a1-846a-ff588b9617fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:58.898603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcdf14f7-2c50-47a1-846a-ff588b9617fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:58.899056 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcdf14f7-2c50-47a1-846a-ff588b9617fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:58.899485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcdf14f7-2c50-47a1-846a-ff588b9617fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:58.929042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dcdf14f7-2c50-47a1-846a-ff588b9617fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Oct 02 01:13:58.929619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 640/1272] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:13:59.941460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-04b820ba-26e0-483e-88c6-9373fc744784 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:13:59.943674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-04b820ba-26e0-483e-88c6-9373fc744784 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:13:59.950474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04b820ba-26e0-483e-88c6-9373fc744784 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:59.952345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04b820ba-26e0-483e-88c6-9373fc744784 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:59.953110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04b820ba-26e0-483e-88c6-9373fc744784 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:59.953832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04b820ba-26e0-483e-88c6-9373fc744784 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:13:59.954306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04b820ba-26e0-483e-88c6-9373fc744784 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:13:59.954734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-04b820ba-26e0-483e-88c6-9373fc744784 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:13:59.985222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-04b820ba-26e0-483e-88c6-9373fc744784 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047703 Oct 02 01:13:59.985792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 633/1273] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:13:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:00.997832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-363ad53b-89b7-429e-8674-d5ce34c8f5da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:01.000080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-363ad53b-89b7-429e-8674-d5ce34c8f5da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:01.006458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363ad53b-89b7-429e-8674-d5ce34c8f5da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:01.006938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363ad53b-89b7-429e-8674-d5ce34c8f5da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:01.007374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363ad53b-89b7-429e-8674-d5ce34c8f5da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:01.008066 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363ad53b-89b7-429e-8674-d5ce34c8f5da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:01.008522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363ad53b-89b7-429e-8674-d5ce34c8f5da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:01.008970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363ad53b-89b7-429e-8674-d5ce34c8f5da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:01.039148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-363ad53b-89b7-429e-8674-d5ce34c8f5da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Oct 02 01:14:01.039708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 641/1274] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:02.052059 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-90fffc12-dc2e-4e8f-846e-c84ebd82ff4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:02.054253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-90fffc12-dc2e-4e8f-846e-c84ebd82ff4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:02.060706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90fffc12-dc2e-4e8f-846e-c84ebd82ff4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:02.061848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90fffc12-dc2e-4e8f-846e-c84ebd82ff4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:02.062321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90fffc12-dc2e-4e8f-846e-c84ebd82ff4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:02.063019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90fffc12-dc2e-4e8f-846e-c84ebd82ff4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:02.063512 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90fffc12-dc2e-4e8f-846e-c84ebd82ff4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:02.063942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-90fffc12-dc2e-4e8f-846e-c84ebd82ff4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:02.093459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-90fffc12-dc2e-4e8f-846e-c84ebd82ff4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045386 Oct 02 01:14:02.094006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 634/1275] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:03.105840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5ba7760-e1ce-4ded-ab41-d0a1e504a530 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:03.108049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5ba7760-e1ce-4ded-ab41-d0a1e504a530 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:03.114622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ba7760-e1ce-4ded-ab41-d0a1e504a530 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:03.115349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ba7760-e1ce-4ded-ab41-d0a1e504a530 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:03.115791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ba7760-e1ce-4ded-ab41-d0a1e504a530 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:03.116476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ba7760-e1ce-4ded-ab41-d0a1e504a530 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:03.116934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ba7760-e1ce-4ded-ab41-d0a1e504a530 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:03.117355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ba7760-e1ce-4ded-ab41-d0a1e504a530 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:03.146616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5ba7760-e1ce-4ded-ab41-d0a1e504a530 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044796 Oct 02 01:14:03.147164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 642/1276] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:04.159423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f69d859f-316b-4f9d-a843-23995054d57b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:04.161562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f69d859f-316b-4f9d-a843-23995054d57b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:04.168018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f69d859f-316b-4f9d-a843-23995054d57b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:04.168496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f69d859f-316b-4f9d-a843-23995054d57b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:04.168932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f69d859f-316b-4f9d-a843-23995054d57b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:04.169617 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f69d859f-316b-4f9d-a843-23995054d57b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:04.170087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f69d859f-316b-4f9d-a843-23995054d57b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:04.170588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f69d859f-316b-4f9d-a843-23995054d57b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:04.198656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f69d859f-316b-4f9d-a843-23995054d57b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Oct 02 01:14:04.199201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 635/1277] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:05.211443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ebd55178-494f-4efb-8c72-e875db3d8b4d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:05.213591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ebd55178-494f-4efb-8c72-e875db3d8b4d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:05.220509 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebd55178-494f-4efb-8c72-e875db3d8b4d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:05.220988 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebd55178-494f-4efb-8c72-e875db3d8b4d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:05.221412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebd55178-494f-4efb-8c72-e875db3d8b4d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:05.222123 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebd55178-494f-4efb-8c72-e875db3d8b4d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:05.222575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebd55178-494f-4efb-8c72-e875db3d8b4d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:05.223001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebd55178-494f-4efb-8c72-e875db3d8b4d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:05.251934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ebd55178-494f-4efb-8c72-e875db3d8b4d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Oct 02 01:14:05.252479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 643/1278] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:06.264201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8357885e-68d0-4276-9927-31adc9a95a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:06.266372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8357885e-68d0-4276-9927-31adc9a95a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:06.272765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8357885e-68d0-4276-9927-31adc9a95a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:06.273241 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8357885e-68d0-4276-9927-31adc9a95a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:06.273674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8357885e-68d0-4276-9927-31adc9a95a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:06.274391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8357885e-68d0-4276-9927-31adc9a95a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:06.274841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8357885e-68d0-4276-9927-31adc9a95a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:06.275263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8357885e-68d0-4276-9927-31adc9a95a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:06.304061 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8357885e-68d0-4276-9927-31adc9a95a7c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043829 Oct 02 01:14:06.304612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 636/1279] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:07.316986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66fcc6d0-9e09-48bb-a4f1-f345c7fc4c40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:07.319221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66fcc6d0-9e09-48bb-a4f1-f345c7fc4c40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:07.325316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66fcc6d0-9e09-48bb-a4f1-f345c7fc4c40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:07.325786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66fcc6d0-9e09-48bb-a4f1-f345c7fc4c40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:07.326267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66fcc6d0-9e09-48bb-a4f1-f345c7fc4c40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:07.326952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66fcc6d0-9e09-48bb-a4f1-f345c7fc4c40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:07.327398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66fcc6d0-9e09-48bb-a4f1-f345c7fc4c40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:07.327818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66fcc6d0-9e09-48bb-a4f1-f345c7fc4c40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:07.357726 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66fcc6d0-9e09-48bb-a4f1-f345c7fc4c40 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Oct 02 01:14:07.358362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 644/1280] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:08.370286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5c5eb1b1-ad4d-4f00-8bb7-10fc8d7fd403 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:08.372413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5c5eb1b1-ad4d-4f00-8bb7-10fc8d7fd403 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:08.378881 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c5eb1b1-ad4d-4f00-8bb7-10fc8d7fd403 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:08.379396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c5eb1b1-ad4d-4f00-8bb7-10fc8d7fd403 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:08.379836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c5eb1b1-ad4d-4f00-8bb7-10fc8d7fd403 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:08.380531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c5eb1b1-ad4d-4f00-8bb7-10fc8d7fd403 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:08.380990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c5eb1b1-ad4d-4f00-8bb7-10fc8d7fd403 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:08.381424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c5eb1b1-ad4d-4f00-8bb7-10fc8d7fd403 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:08.410175 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5c5eb1b1-ad4d-4f00-8bb7-10fc8d7fd403 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Oct 02 01:14:08.410723 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 637/1281] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:08 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:09.421826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef8b72be-1bbb-4f6c-9c33-28600453d533 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:09.424345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef8b72be-1bbb-4f6c-9c33-28600453d533 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:09.430986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8b72be-1bbb-4f6c-9c33-28600453d533 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:09.431451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8b72be-1bbb-4f6c-9c33-28600453d533 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:09.431938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8b72be-1bbb-4f6c-9c33-28600453d533 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:09.432585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8b72be-1bbb-4f6c-9c33-28600453d533 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:09.433042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8b72be-1bbb-4f6c-9c33-28600453d533 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:09.433471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef8b72be-1bbb-4f6c-9c33-28600453d533 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:09.462139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef8b72be-1bbb-4f6c-9c33-28600453d533 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Oct 02 01:14:09.462694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 645/1282] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:10.474798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bcf15c47-cab6-4816-a32c-5d7ca7844618 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:10.476932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bcf15c47-cab6-4816-a32c-5d7ca7844618 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:10.483873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcf15c47-cab6-4816-a32c-5d7ca7844618 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:10.484352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcf15c47-cab6-4816-a32c-5d7ca7844618 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:10.484782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcf15c47-cab6-4816-a32c-5d7ca7844618 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:10.485465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcf15c47-cab6-4816-a32c-5d7ca7844618 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:10.485914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcf15c47-cab6-4816-a32c-5d7ca7844618 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:10.486356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bcf15c47-cab6-4816-a32c-5d7ca7844618 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:10.514616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bcf15c47-cab6-4816-a32c-5d7ca7844618 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043699 Oct 02 01:14:10.515176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 638/1283] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:11.526998 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b249059-bd28-491e-b5a8-b467d97030ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:11.529178 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b249059-bd28-491e-b5a8-b467d97030ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:11.536170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b249059-bd28-491e-b5a8-b467d97030ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:11.536651 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b249059-bd28-491e-b5a8-b467d97030ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:11.537078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b249059-bd28-491e-b5a8-b467d97030ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:11.537762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b249059-bd28-491e-b5a8-b467d97030ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:11.538245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b249059-bd28-491e-b5a8-b467d97030ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:11.538695 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b249059-bd28-491e-b5a8-b467d97030ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:11.566302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b249059-bd28-491e-b5a8-b467d97030ad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043236 Oct 02 01:14:11.566841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 646/1284] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:12.578688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ed290afa-8869-49dd-b2b5-809a4aba44c6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:12.580831 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ed290afa-8869-49dd-b2b5-809a4aba44c6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:12.583127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:12.588605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed290afa-8869-49dd-b2b5-809a4aba44c6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:12.589085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed290afa-8869-49dd-b2b5-809a4aba44c6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:12.589517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed290afa-8869-49dd-b2b5-809a4aba44c6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:12.590245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed290afa-8869-49dd-b2b5-809a4aba44c6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:12.590696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed290afa-8869-49dd-b2b5-809a4aba44c6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:12.591116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed290afa-8869-49dd-b2b5-809a4aba44c6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:12.620659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ed290afa-8869-49dd-b2b5-809a4aba44c6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045951 Oct 02 01:14:12.621208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 639/1285] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:13.633215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5304c73-944a-4ee6-b3d8-ed9a5efda1f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:13.635432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a5304c73-944a-4ee6-b3d8-ed9a5efda1f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:13.637803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:13.643683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5304c73-944a-4ee6-b3d8-ed9a5efda1f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:13.644157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5304c73-944a-4ee6-b3d8-ed9a5efda1f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:13.644589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5304c73-944a-4ee6-b3d8-ed9a5efda1f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:13.645272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5304c73-944a-4ee6-b3d8-ed9a5efda1f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:13.645719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5304c73-944a-4ee6-b3d8-ed9a5efda1f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:13.646170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5304c73-944a-4ee6-b3d8-ed9a5efda1f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:13.650117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:13.675262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a5304c73-944a-4ee6-b3d8-ed9a5efda1f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046108 Oct 02 01:14:13.675813 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 647/1286] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:14.688317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aa6490d7-5ece-4488-9bc1-aeaaf271ba1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:14.690491 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aa6490d7-5ece-4488-9bc1-aeaaf271ba1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:14.696938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa6490d7-5ece-4488-9bc1-aeaaf271ba1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:14.697414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa6490d7-5ece-4488-9bc1-aeaaf271ba1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:14.697854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa6490d7-5ece-4488-9bc1-aeaaf271ba1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:14.698647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa6490d7-5ece-4488-9bc1-aeaaf271ba1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:14.699102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa6490d7-5ece-4488-9bc1-aeaaf271ba1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:14.699525 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa6490d7-5ece-4488-9bc1-aeaaf271ba1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:14.703057 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:14.728066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aa6490d7-5ece-4488-9bc1-aeaaf271ba1b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Oct 02 01:14:14.728625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 640/1287] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:15.740748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d6c0c3a-53ff-4d93-9043-8f159526056c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:15.742945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d6c0c3a-53ff-4d93-9043-8f159526056c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:15.749304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6c0c3a-53ff-4d93-9043-8f159526056c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:15.749777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6c0c3a-53ff-4d93-9043-8f159526056c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:15.750244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6c0c3a-53ff-4d93-9043-8f159526056c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:15.750923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6c0c3a-53ff-4d93-9043-8f159526056c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:15.751366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6c0c3a-53ff-4d93-9043-8f159526056c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:15.751786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6c0c3a-53ff-4d93-9043-8f159526056c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:15.779466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d6c0c3a-53ff-4d93-9043-8f159526056c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043001 Oct 02 01:14:15.780519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 648/1288] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:16.792371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-abbd3e45-3314-4815-a015-fdcf0f8cadb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:16.794577 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-abbd3e45-3314-4815-a015-fdcf0f8cadb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:16.801475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbd3e45-3314-4815-a015-fdcf0f8cadb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:16.801957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbd3e45-3314-4815-a015-fdcf0f8cadb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:16.802428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbd3e45-3314-4815-a015-fdcf0f8cadb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:16.803120 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbd3e45-3314-4815-a015-fdcf0f8cadb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:16.803576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbd3e45-3314-4815-a015-fdcf0f8cadb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:16.804000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-abbd3e45-3314-4815-a015-fdcf0f8cadb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:16.832804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-abbd3e45-3314-4815-a015-fdcf0f8cadb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044427 Oct 02 01:14:16.833352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 641/1289] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:17.847461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b6e9ccfe-7d25-47b7-88f4-a3571f2f888e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:17.849632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b6e9ccfe-7d25-47b7-88f4-a3571f2f888e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:17.856084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e9ccfe-7d25-47b7-88f4-a3571f2f888e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:17.856566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e9ccfe-7d25-47b7-88f4-a3571f2f888e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:17.857000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e9ccfe-7d25-47b7-88f4-a3571f2f888e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:17.857689 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e9ccfe-7d25-47b7-88f4-a3571f2f888e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:17.858790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e9ccfe-7d25-47b7-88f4-a3571f2f888e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:17.859218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6e9ccfe-7d25-47b7-88f4-a3571f2f888e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:17.887524 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b6e9ccfe-7d25-47b7-88f4-a3571f2f888e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Oct 02 01:14:17.888066 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 649/1290] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:18.899259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-be860ece-2eaf-4fd1-bba4-8c10821c0886 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:18.901453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-be860ece-2eaf-4fd1-bba4-8c10821c0886 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:18.907870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be860ece-2eaf-4fd1-bba4-8c10821c0886 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:18.908356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be860ece-2eaf-4fd1-bba4-8c10821c0886 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:18.908797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be860ece-2eaf-4fd1-bba4-8c10821c0886 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:18.909527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be860ece-2eaf-4fd1-bba4-8c10821c0886 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:18.909986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be860ece-2eaf-4fd1-bba4-8c10821c0886 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:18.910452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be860ece-2eaf-4fd1-bba4-8c10821c0886 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:18.939702 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-be860ece-2eaf-4fd1-bba4-8c10821c0886 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Oct 02 01:14:18.940253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 642/1291] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:19.952561 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a7ccd83c-ffbe-476f-8aa4-af27202c318d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:19.954739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a7ccd83c-ffbe-476f-8aa4-af27202c318d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:19.961050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7ccd83c-ffbe-476f-8aa4-af27202c318d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:19.961525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7ccd83c-ffbe-476f-8aa4-af27202c318d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:19.961951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7ccd83c-ffbe-476f-8aa4-af27202c318d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:19.962657 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7ccd83c-ffbe-476f-8aa4-af27202c318d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:19.963106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7ccd83c-ffbe-476f-8aa4-af27202c318d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:19.963525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7ccd83c-ffbe-476f-8aa4-af27202c318d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:19.993107 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a7ccd83c-ffbe-476f-8aa4-af27202c318d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Oct 02 01:14:19.993625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 650/1292] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:21.005372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-636d4c1c-62c9-4b98-b541-b2f5e095a1bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:21.007551 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-636d4c1c-62c9-4b98-b541-b2f5e095a1bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:21.014927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-636d4c1c-62c9-4b98-b541-b2f5e095a1bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:21.015419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-636d4c1c-62c9-4b98-b541-b2f5e095a1bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:21.015861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-636d4c1c-62c9-4b98-b541-b2f5e095a1bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:21.016558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-636d4c1c-62c9-4b98-b541-b2f5e095a1bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:21.017012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-636d4c1c-62c9-4b98-b541-b2f5e095a1bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:21.017437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-636d4c1c-62c9-4b98-b541-b2f5e095a1bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:21.047070 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-636d4c1c-62c9-4b98-b541-b2f5e095a1bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045620 Oct 02 01:14:21.047625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 643/1293] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:22.059607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8939d9d-dbe9-42c5-aa7e-11a5dd0ba463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:22.062414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c8939d9d-dbe9-42c5-aa7e-11a5dd0ba463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:22.068758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8939d9d-dbe9-42c5-aa7e-11a5dd0ba463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.069233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8939d9d-dbe9-42c5-aa7e-11a5dd0ba463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.069660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8939d9d-dbe9-42c5-aa7e-11a5dd0ba463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.070368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8939d9d-dbe9-42c5-aa7e-11a5dd0ba463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:22.070818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8939d9d-dbe9-42c5-aa7e-11a5dd0ba463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:22.071241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8939d9d-dbe9-42c5-aa7e-11a5dd0ba463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:22.098837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8939d9d-dbe9-42c5-aa7e-11a5dd0ba463 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043287 Oct 02 01:14:22.099373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 651/1294] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:23.111370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3c7446f1-5fc7-4aca-a90a-0ee8f9d72172 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:23.113498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3c7446f1-5fc7-4aca-a90a-0ee8f9d72172 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:23.120174 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c7446f1-5fc7-4aca-a90a-0ee8f9d72172 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:23.120656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c7446f1-5fc7-4aca-a90a-0ee8f9d72172 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:23.121091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c7446f1-5fc7-4aca-a90a-0ee8f9d72172 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:23.121777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c7446f1-5fc7-4aca-a90a-0ee8f9d72172 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:23.122261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c7446f1-5fc7-4aca-a90a-0ee8f9d72172 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:23.122688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c7446f1-5fc7-4aca-a90a-0ee8f9d72172 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:23.152029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3c7446f1-5fc7-4aca-a90a-0ee8f9d72172 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Oct 02 01:14:23.152581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 644/1295] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:24.164637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7232783b-a5fc-4e35-aeba-d32d1a2a75aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:24.166797 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7232783b-a5fc-4e35-aeba-d32d1a2a75aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:24.173817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7232783b-a5fc-4e35-aeba-d32d1a2a75aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.174324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7232783b-a5fc-4e35-aeba-d32d1a2a75aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.174751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7232783b-a5fc-4e35-aeba-d32d1a2a75aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.175431 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7232783b-a5fc-4e35-aeba-d32d1a2a75aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:24.175875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7232783b-a5fc-4e35-aeba-d32d1a2a75aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:24.176293 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7232783b-a5fc-4e35-aeba-d32d1a2a75aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:24.204968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7232783b-a5fc-4e35-aeba-d32d1a2a75aa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Oct 02 01:14:24.205562 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 652/1296] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:25.216780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a31d4e1b-69fd-480f-8318-736f7ab5fa7f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:25.219075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a31d4e1b-69fd-480f-8318-736f7ab5fa7f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:25.225437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a31d4e1b-69fd-480f-8318-736f7ab5fa7f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:25.225911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a31d4e1b-69fd-480f-8318-736f7ab5fa7f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:25.226449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a31d4e1b-69fd-480f-8318-736f7ab5fa7f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:25.227135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a31d4e1b-69fd-480f-8318-736f7ab5fa7f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:25.227581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a31d4e1b-69fd-480f-8318-736f7ab5fa7f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:25.228001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a31d4e1b-69fd-480f-8318-736f7ab5fa7f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:25.257216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a31d4e1b-69fd-480f-8318-736f7ab5fa7f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Oct 02 01:14:25.257765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 645/1297] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:26.269023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae1c9ea8-06b9-4757-80dd-c0f456a217b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:26.271237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae1c9ea8-06b9-4757-80dd-c0f456a217b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:26.277664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1c9ea8-06b9-4757-80dd-c0f456a217b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:26.278175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1c9ea8-06b9-4757-80dd-c0f456a217b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:26.278616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1c9ea8-06b9-4757-80dd-c0f456a217b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:26.279306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1c9ea8-06b9-4757-80dd-c0f456a217b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:26.280252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1c9ea8-06b9-4757-80dd-c0f456a217b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:26.280678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1c9ea8-06b9-4757-80dd-c0f456a217b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:26.309324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae1c9ea8-06b9-4757-80dd-c0f456a217b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044170 Oct 02 01:14:26.309803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 653/1298] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:27.321637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d0df7197-0e67-4865-84c6-7fb21efd18d3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:27.323755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d0df7197-0e67-4865-84c6-7fb21efd18d3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:27.330695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0df7197-0e67-4865-84c6-7fb21efd18d3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:27.331173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0df7197-0e67-4865-84c6-7fb21efd18d3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:27.331603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0df7197-0e67-4865-84c6-7fb21efd18d3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.332284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0df7197-0e67-4865-84c6-7fb21efd18d3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:27.332732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0df7197-0e67-4865-84c6-7fb21efd18d3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:27.333151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d0df7197-0e67-4865-84c6-7fb21efd18d3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:27.362525 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d0df7197-0e67-4865-84c6-7fb21efd18d3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Oct 02 01:14:27.363084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 646/1299] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:28.375783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71fb9e79-c4ce-4dad-ae97-3e73e392e0f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:28.377843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71fb9e79-c4ce-4dad-ae97-3e73e392e0f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:28.384226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71fb9e79-c4ce-4dad-ae97-3e73e392e0f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:28.384705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71fb9e79-c4ce-4dad-ae97-3e73e392e0f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:28.385140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71fb9e79-c4ce-4dad-ae97-3e73e392e0f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:28.385828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71fb9e79-c4ce-4dad-ae97-3e73e392e0f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:28.386309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71fb9e79-c4ce-4dad-ae97-3e73e392e0f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:28.386733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71fb9e79-c4ce-4dad-ae97-3e73e392e0f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:28.415235 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71fb9e79-c4ce-4dad-ae97-3e73e392e0f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Oct 02 01:14:28.415783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 654/1300] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:29.427629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-955fbd3a-2b15-456e-b385-83de13986553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:29.429785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-955fbd3a-2b15-456e-b385-83de13986553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:29.435886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-955fbd3a-2b15-456e-b385-83de13986553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:29.436362 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-955fbd3a-2b15-456e-b385-83de13986553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:29.436797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-955fbd3a-2b15-456e-b385-83de13986553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:29.437486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-955fbd3a-2b15-456e-b385-83de13986553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:29.437947 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-955fbd3a-2b15-456e-b385-83de13986553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:29.438400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-955fbd3a-2b15-456e-b385-83de13986553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:29.468439 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-955fbd3a-2b15-456e-b385-83de13986553 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Oct 02 01:14:29.469002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 647/1301] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:30.480907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c65f626-7949-4800-ad9b-b414dc0394fa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:30.483520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c65f626-7949-4800-ad9b-b414dc0394fa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:30.490461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c65f626-7949-4800-ad9b-b414dc0394fa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:30.490944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c65f626-7949-4800-ad9b-b414dc0394fa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:30.491378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c65f626-7949-4800-ad9b-b414dc0394fa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:30.492079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c65f626-7949-4800-ad9b-b414dc0394fa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:30.492557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c65f626-7949-4800-ad9b-b414dc0394fa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:30.492979 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c65f626-7949-4800-ad9b-b414dc0394fa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:30.522669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c65f626-7949-4800-ad9b-b414dc0394fa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045826 Oct 02 01:14:30.523212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 655/1302] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:31.535186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-72d1034a-2fe4-4223-bdfd-61c3cfdf91df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:31.537316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-72d1034a-2fe4-4223-bdfd-61c3cfdf91df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:31.543808 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d1034a-2fe4-4223-bdfd-61c3cfdf91df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.544285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d1034a-2fe4-4223-bdfd-61c3cfdf91df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.544716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d1034a-2fe4-4223-bdfd-61c3cfdf91df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.545398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d1034a-2fe4-4223-bdfd-61c3cfdf91df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:31.545844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d1034a-2fe4-4223-bdfd-61c3cfdf91df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:31.546295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72d1034a-2fe4-4223-bdfd-61c3cfdf91df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:31.575119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-72d1034a-2fe4-4223-bdfd-61c3cfdf91df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Oct 02 01:14:31.575672 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 648/1303] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:32.589478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69a04518-74af-4eb3-b80d-4d06836ad86b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:32.592172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69a04518-74af-4eb3-b80d-4d06836ad86b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:32.600711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69a04518-74af-4eb3-b80d-4d06836ad86b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.601190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69a04518-74af-4eb3-b80d-4d06836ad86b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.601625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69a04518-74af-4eb3-b80d-4d06836ad86b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.602351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69a04518-74af-4eb3-b80d-4d06836ad86b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:32.602806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69a04518-74af-4eb3-b80d-4d06836ad86b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:32.603234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69a04518-74af-4eb3-b80d-4d06836ad86b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:32.633475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-69a04518-74af-4eb3-b80d-4d06836ad86b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049303 Oct 02 01:14:32.634051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 656/1304] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:33.645852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ac083acf-c328-450b-92b6-3fa18db36aa2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:33.648011 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ac083acf-c328-450b-92b6-3fa18db36aa2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:33.655533 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac083acf-c328-450b-92b6-3fa18db36aa2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.656017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac083acf-c328-450b-92b6-3fa18db36aa2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.656454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac083acf-c328-450b-92b6-3fa18db36aa2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.657151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac083acf-c328-450b-92b6-3fa18db36aa2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:33.657602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac083acf-c328-450b-92b6-3fa18db36aa2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:33.658026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac083acf-c328-450b-92b6-3fa18db36aa2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:33.686809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ac083acf-c328-450b-92b6-3fa18db36aa2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Oct 02 01:14:33.687355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 649/1305] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:34.699023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b930f11-0746-4214-83ce-20ab518df57e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:34.701195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b930f11-0746-4214-83ce-20ab518df57e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:34.707659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b930f11-0746-4214-83ce-20ab518df57e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.708137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b930f11-0746-4214-83ce-20ab518df57e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.708568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b930f11-0746-4214-83ce-20ab518df57e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.709255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b930f11-0746-4214-83ce-20ab518df57e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:34.709706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b930f11-0746-4214-83ce-20ab518df57e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:34.710167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b930f11-0746-4214-83ce-20ab518df57e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:34.738479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b930f11-0746-4214-83ce-20ab518df57e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Oct 02 01:14:34.739017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 657/1306] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:35.750938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8fcd3b02-06a1-43e8-9bee-a5d0bd2d87ef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:35.753088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8fcd3b02-06a1-43e8-9bee-a5d0bd2d87ef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:35.759554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fcd3b02-06a1-43e8-9bee-a5d0bd2d87ef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.760030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fcd3b02-06a1-43e8-9bee-a5d0bd2d87ef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.760475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fcd3b02-06a1-43e8-9bee-a5d0bd2d87ef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.761141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fcd3b02-06a1-43e8-9bee-a5d0bd2d87ef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:35.761587 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fcd3b02-06a1-43e8-9bee-a5d0bd2d87ef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:35.762006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8fcd3b02-06a1-43e8-9bee-a5d0bd2d87ef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:35.790932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8fcd3b02-06a1-43e8-9bee-a5d0bd2d87ef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043963 Oct 02 01:14:35.791481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 650/1307] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:36.802841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c745c8f3-f551-4702-9d37-5b86f10aedd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:36.805032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c745c8f3-f551-4702-9d37-5b86f10aedd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:36.811209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c745c8f3-f551-4702-9d37-5b86f10aedd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.811691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c745c8f3-f551-4702-9d37-5b86f10aedd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.812130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c745c8f3-f551-4702-9d37-5b86f10aedd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:36.812823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c745c8f3-f551-4702-9d37-5b86f10aedd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:36.813281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c745c8f3-f551-4702-9d37-5b86f10aedd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:36.813713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c745c8f3-f551-4702-9d37-5b86f10aedd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:36.842283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c745c8f3-f551-4702-9d37-5b86f10aedd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 Oct 02 01:14:36.842827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 658/1308] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:37.854517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cf02609a-32c8-4b7b-9c31-ec676cd5150a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:37.856601 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cf02609a-32c8-4b7b-9c31-ec676cd5150a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:37.863497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02609a-32c8-4b7b-9c31-ec676cd5150a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:37.863978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02609a-32c8-4b7b-9c31-ec676cd5150a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:37.864416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02609a-32c8-4b7b-9c31-ec676cd5150a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:37.865434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02609a-32c8-4b7b-9c31-ec676cd5150a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:37.865892 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02609a-32c8-4b7b-9c31-ec676cd5150a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:37.866351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf02609a-32c8-4b7b-9c31-ec676cd5150a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:37.894993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cf02609a-32c8-4b7b-9c31-ec676cd5150a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Oct 02 01:14:37.895539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 651/1309] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:38.906871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a9081854-1532-4261-9cfe-a08dcb1830f5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:38.909007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a9081854-1532-4261-9cfe-a08dcb1830f5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:38.915334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9081854-1532-4261-9cfe-a08dcb1830f5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:38.915808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9081854-1532-4261-9cfe-a08dcb1830f5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:38.916238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9081854-1532-4261-9cfe-a08dcb1830f5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:38.916917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9081854-1532-4261-9cfe-a08dcb1830f5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:38.917360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9081854-1532-4261-9cfe-a08dcb1830f5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:38.917780 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9081854-1532-4261-9cfe-a08dcb1830f5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:38.946104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a9081854-1532-4261-9cfe-a08dcb1830f5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043154 Oct 02 01:14:38.946644 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 659/1310] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:39.959508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c90e2c3a-c86c-448e-bbe0-423fa92d1353 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:39.961711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c90e2c3a-c86c-448e-bbe0-423fa92d1353 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:39.968678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90e2c3a-c86c-448e-bbe0-423fa92d1353 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:39.969157 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90e2c3a-c86c-448e-bbe0-423fa92d1353 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:39.969593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90e2c3a-c86c-448e-bbe0-423fa92d1353 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:39.970313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90e2c3a-c86c-448e-bbe0-423fa92d1353 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:39.970766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90e2c3a-c86c-448e-bbe0-423fa92d1353 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:39.971187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c90e2c3a-c86c-448e-bbe0-423fa92d1353 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:39.999256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c90e2c3a-c86c-448e-bbe0-423fa92d1353 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Oct 02 01:14:39.999795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 652/1311] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:41.011708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b1af422-2a14-4dfb-81c3-81b0a387d6ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:41.013939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b1af422-2a14-4dfb-81c3-81b0a387d6ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:41.020391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1af422-2a14-4dfb-81c3-81b0a387d6ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.020806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1af422-2a14-4dfb-81c3-81b0a387d6ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.021239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1af422-2a14-4dfb-81c3-81b0a387d6ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.021923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1af422-2a14-4dfb-81c3-81b0a387d6ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:41.022409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1af422-2a14-4dfb-81c3-81b0a387d6ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:41.022831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1af422-2a14-4dfb-81c3-81b0a387d6ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:41.052329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b1af422-2a14-4dfb-81c3-81b0a387d6ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Oct 02 01:14:41.052889 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 660/1312] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:42.065494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f27cdc20-7386-4bb1-9d23-b4dd4fce25ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:42.067667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f27cdc20-7386-4bb1-9d23-b4dd4fce25ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:42.074103 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27cdc20-7386-4bb1-9d23-b4dd4fce25ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.074588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27cdc20-7386-4bb1-9d23-b4dd4fce25ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.075026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27cdc20-7386-4bb1-9d23-b4dd4fce25ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.075715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27cdc20-7386-4bb1-9d23-b4dd4fce25ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:42.076838 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27cdc20-7386-4bb1-9d23-b4dd4fce25ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:42.077264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27cdc20-7386-4bb1-9d23-b4dd4fce25ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:42.105210 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f27cdc20-7386-4bb1-9d23-b4dd4fce25ac tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Oct 02 01:14:42.105755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 653/1313] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:43.117621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64d79033-0995-465a-a53f-d64b790123f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:43.119757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-64d79033-0995-465a-a53f-d64b790123f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:43.126182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64d79033-0995-465a-a53f-d64b790123f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:43.126656 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64d79033-0995-465a-a53f-d64b790123f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:43.127085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64d79033-0995-465a-a53f-d64b790123f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:43.127766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64d79033-0995-465a-a53f-d64b790123f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:43.128212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64d79033-0995-465a-a53f-d64b790123f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:43.128636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64d79033-0995-465a-a53f-d64b790123f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:43.157320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-64d79033-0995-465a-a53f-d64b790123f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Oct 02 01:14:43.157855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 661/1314] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:44.168795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7a25000f-4e77-462f-99de-992766375000 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:44.171644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7a25000f-4e77-462f-99de-992766375000 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:44.173955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:44.179181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a25000f-4e77-462f-99de-992766375000 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.179658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a25000f-4e77-462f-99de-992766375000 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.180090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a25000f-4e77-462f-99de-992766375000 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.180778 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a25000f-4e77-462f-99de-992766375000 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:44.181228 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a25000f-4e77-462f-99de-992766375000 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:44.181651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7a25000f-4e77-462f-99de-992766375000 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:44.210948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7a25000f-4e77-462f-99de-992766375000 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Oct 02 01:14:44.211711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 654/1315] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:45.223569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4838d911-1235-44e9-b557-bd6c3bcc2831 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:45.225705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4838d911-1235-44e9-b557-bd6c3bcc2831 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:45.228109 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:45.234005 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4838d911-1235-44e9-b557-bd6c3bcc2831 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.234518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4838d911-1235-44e9-b557-bd6c3bcc2831 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.234951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4838d911-1235-44e9-b557-bd6c3bcc2831 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.235642 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4838d911-1235-44e9-b557-bd6c3bcc2831 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:45.236092 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4838d911-1235-44e9-b557-bd6c3bcc2831 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:45.236516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4838d911-1235-44e9-b557-bd6c3bcc2831 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:45.240351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:45.266715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4838d911-1235-44e9-b557-bd6c3bcc2831 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047091 Oct 02 01:14:45.267279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 662/1316] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:46.279874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-db422481-1e2f-468a-bfe3-82e0ecb002fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:46.282023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-db422481-1e2f-468a-bfe3-82e0ecb002fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:46.288455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db422481-1e2f-468a-bfe3-82e0ecb002fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:46.288927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db422481-1e2f-468a-bfe3-82e0ecb002fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:46.289354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db422481-1e2f-468a-bfe3-82e0ecb002fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:46.290034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db422481-1e2f-468a-bfe3-82e0ecb002fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:46.290508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db422481-1e2f-468a-bfe3-82e0ecb002fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:46.290926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db422481-1e2f-468a-bfe3-82e0ecb002fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:46.293216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:14:46.320089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-db422481-1e2f-468a-bfe3-82e0ecb002fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Oct 02 01:14:46.320637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 655/1317] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:47.332419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e28e5949-4d4e-4a75-b99f-466423d29918 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:47.334640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e28e5949-4d4e-4a75-b99f-466423d29918 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:47.340952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e28e5949-4d4e-4a75-b99f-466423d29918 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:47.341427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e28e5949-4d4e-4a75-b99f-466423d29918 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:47.341856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e28e5949-4d4e-4a75-b99f-466423d29918 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:47.342564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e28e5949-4d4e-4a75-b99f-466423d29918 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:47.343014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e28e5949-4d4e-4a75-b99f-466423d29918 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:47.343433 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e28e5949-4d4e-4a75-b99f-466423d29918 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:47.371564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e28e5949-4d4e-4a75-b99f-466423d29918 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Oct 02 01:14:47.372101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 663/1318] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:48.384288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-da2928bf-d4c1-43d8-b882-5b2fe6d4a442 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:48.386503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-da2928bf-d4c1-43d8-b882-5b2fe6d4a442 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:48.393443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2928bf-d4c1-43d8-b882-5b2fe6d4a442 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:48.393923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2928bf-d4c1-43d8-b882-5b2fe6d4a442 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:48.394401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2928bf-d4c1-43d8-b882-5b2fe6d4a442 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:48.395092 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2928bf-d4c1-43d8-b882-5b2fe6d4a442 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:48.395543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2928bf-d4c1-43d8-b882-5b2fe6d4a442 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:48.395967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-da2928bf-d4c1-43d8-b882-5b2fe6d4a442 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:48.424523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-da2928bf-d4c1-43d8-b882-5b2fe6d4a442 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Oct 02 01:14:48.425070 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 656/1319] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:49.437079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dc4b524e-0ee5-4af1-94b0-f4c722020a63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:49.439150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dc4b524e-0ee5-4af1-94b0-f4c722020a63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:49.445509 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc4b524e-0ee5-4af1-94b0-f4c722020a63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:49.445983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc4b524e-0ee5-4af1-94b0-f4c722020a63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:49.446475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc4b524e-0ee5-4af1-94b0-f4c722020a63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:49.447164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc4b524e-0ee5-4af1-94b0-f4c722020a63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:49.447619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc4b524e-0ee5-4af1-94b0-f4c722020a63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:49.448042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc4b524e-0ee5-4af1-94b0-f4c722020a63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:49.476162 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dc4b524e-0ee5-4af1-94b0-f4c722020a63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 Oct 02 01:14:49.476709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 664/1320] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:50.488360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c8672101-206d-47a2-8fed-512cf46072da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:50.490709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c8672101-206d-47a2-8fed-512cf46072da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:50.497024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8672101-206d-47a2-8fed-512cf46072da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:50.498145 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8672101-206d-47a2-8fed-512cf46072da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:50.498591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8672101-206d-47a2-8fed-512cf46072da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:50.499280 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8672101-206d-47a2-8fed-512cf46072da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:50.499734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8672101-206d-47a2-8fed-512cf46072da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:50.500158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c8672101-206d-47a2-8fed-512cf46072da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:50.527982 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c8672101-206d-47a2-8fed-512cf46072da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 Oct 02 01:14:50.528529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 657/1321] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:51.540275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16a31a6d-1f2e-4a82-86a6-7c2f7dba9be5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:51.542440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16a31a6d-1f2e-4a82-86a6-7c2f7dba9be5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:51.548859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a31a6d-1f2e-4a82-86a6-7c2f7dba9be5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:51.549332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a31a6d-1f2e-4a82-86a6-7c2f7dba9be5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:51.549763 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a31a6d-1f2e-4a82-86a6-7c2f7dba9be5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:51.550525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a31a6d-1f2e-4a82-86a6-7c2f7dba9be5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:51.554557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a31a6d-1f2e-4a82-86a6-7c2f7dba9be5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:51.555465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a31a6d-1f2e-4a82-86a6-7c2f7dba9be5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:51.585449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16a31a6d-1f2e-4a82-86a6-7c2f7dba9be5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049070 Oct 02 01:14:51.586001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 665/1322] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:52.598246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-37c6ce83-6031-4295-ab2e-eaf092a13622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:52.600428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-37c6ce83-6031-4295-ab2e-eaf092a13622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:52.607484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37c6ce83-6031-4295-ab2e-eaf092a13622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:52.607970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37c6ce83-6031-4295-ab2e-eaf092a13622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:52.613450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37c6ce83-6031-4295-ab2e-eaf092a13622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:52.613450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37c6ce83-6031-4295-ab2e-eaf092a13622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:52.613450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37c6ce83-6031-4295-ab2e-eaf092a13622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:52.613450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37c6ce83-6031-4295-ab2e-eaf092a13622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:52.639894 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-37c6ce83-6031-4295-ab2e-eaf092a13622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 Oct 02 01:14:52.640452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 658/1323] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:53.652172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb14555f-22fd-4e89-9d85-1e2aec22a713 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:53.654398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eb14555f-22fd-4e89-9d85-1e2aec22a713 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:53.660932 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb14555f-22fd-4e89-9d85-1e2aec22a713 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:53.661415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb14555f-22fd-4e89-9d85-1e2aec22a713 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:53.661858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb14555f-22fd-4e89-9d85-1e2aec22a713 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:53.662581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb14555f-22fd-4e89-9d85-1e2aec22a713 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:53.663043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb14555f-22fd-4e89-9d85-1e2aec22a713 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:53.663473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb14555f-22fd-4e89-9d85-1e2aec22a713 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:53.692696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb14555f-22fd-4e89-9d85-1e2aec22a713 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Oct 02 01:14:53.693237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 666/1324] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:54.705590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e88c41dc-8ad0-4179-a7bd-069fa5c1ddaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:54.707798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e88c41dc-8ad0-4179-a7bd-069fa5c1ddaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:54.714253 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e88c41dc-8ad0-4179-a7bd-069fa5c1ddaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:54.714739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e88c41dc-8ad0-4179-a7bd-069fa5c1ddaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:54.715179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e88c41dc-8ad0-4179-a7bd-069fa5c1ddaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:54.715870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e88c41dc-8ad0-4179-a7bd-069fa5c1ddaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:54.716331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e88c41dc-8ad0-4179-a7bd-069fa5c1ddaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:54.716758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e88c41dc-8ad0-4179-a7bd-069fa5c1ddaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:54.745514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e88c41dc-8ad0-4179-a7bd-069fa5c1ddaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043829 Oct 02 01:14:54.746084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 659/1325] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:55.758264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a105ef5-72fe-4560-9655-64945ad862a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:55.760414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a105ef5-72fe-4560-9655-64945ad862a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:55.767417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a105ef5-72fe-4560-9655-64945ad862a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.767897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a105ef5-72fe-4560-9655-64945ad862a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.768338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a105ef5-72fe-4560-9655-64945ad862a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:55.769024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a105ef5-72fe-4560-9655-64945ad862a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:55.769477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a105ef5-72fe-4560-9655-64945ad862a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:55.769904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a105ef5-72fe-4560-9655-64945ad862a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:55.798548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a105ef5-72fe-4560-9655-64945ad862a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Oct 02 01:14:55.799090 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 667/1326] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:56.811298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ff01c032-6fe5-4f2d-a444-98bbcebaafd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:56.813417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ff01c032-6fe5-4f2d-a444-98bbcebaafd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:56.819848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff01c032-6fe5-4f2d-a444-98bbcebaafd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:56.820323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff01c032-6fe5-4f2d-a444-98bbcebaafd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:56.820750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff01c032-6fe5-4f2d-a444-98bbcebaafd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:56.821432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff01c032-6fe5-4f2d-a444-98bbcebaafd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:56.821877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff01c032-6fe5-4f2d-a444-98bbcebaafd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:56.822323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff01c032-6fe5-4f2d-a444-98bbcebaafd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:56.850868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ff01c032-6fe5-4f2d-a444-98bbcebaafd9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Oct 02 01:14:56.851410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 660/1327] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:57.863785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98724081-f207-4a09-8a14-f587d79bb040 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:57.866312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98724081-f207-4a09-8a14-f587d79bb040 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:57.872766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98724081-f207-4a09-8a14-f587d79bb040 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:57.873253 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98724081-f207-4a09-8a14-f587d79bb040 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:57.873693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98724081-f207-4a09-8a14-f587d79bb040 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:57.874421 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98724081-f207-4a09-8a14-f587d79bb040 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:57.874879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98724081-f207-4a09-8a14-f587d79bb040 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:57.875310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98724081-f207-4a09-8a14-f587d79bb040 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:57.904186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98724081-f207-4a09-8a14-f587d79bb040 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Oct 02 01:14:57.904736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 668/1328] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:58.916596 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2c83f9f8-ec4d-4db4-bebe-4b2bee062fae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:58.918837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2c83f9f8-ec4d-4db4-bebe-4b2bee062fae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:58.925486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c83f9f8-ec4d-4db4-bebe-4b2bee062fae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:58.926000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c83f9f8-ec4d-4db4-bebe-4b2bee062fae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:58.926470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c83f9f8-ec4d-4db4-bebe-4b2bee062fae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:58.927159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c83f9f8-ec4d-4db4-bebe-4b2bee062fae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:58.927613 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c83f9f8-ec4d-4db4-bebe-4b2bee062fae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:58.928041 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c83f9f8-ec4d-4db4-bebe-4b2bee062fae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:58.957138 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2c83f9f8-ec4d-4db4-bebe-4b2bee062fae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Oct 02 01:14:58.957688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 661/1329] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:14:59.968871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-102e7adb-104b-4767-a3fb-c273521fad8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:14:59.971059 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-102e7adb-104b-4767-a3fb-c273521fad8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:14:59.977479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-102e7adb-104b-4767-a3fb-c273521fad8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:59.977968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-102e7adb-104b-4767-a3fb-c273521fad8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:59.978443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-102e7adb-104b-4767-a3fb-c273521fad8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:14:59.979139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-102e7adb-104b-4767-a3fb-c273521fad8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:14:59.979594 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-102e7adb-104b-4767-a3fb-c273521fad8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:14:59.980021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-102e7adb-104b-4767-a3fb-c273521fad8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:00.009280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-102e7adb-104b-4767-a3fb-c273521fad8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Oct 02 01:15:00.009833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 669/1330] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:14:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:01.022220 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1abd1afe-e03c-4d40-bcd7-63a29e7af239 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:01.024372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1abd1afe-e03c-4d40-bcd7-63a29e7af239 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:01.032389 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1abd1afe-e03c-4d40-bcd7-63a29e7af239 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:01.032885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1abd1afe-e03c-4d40-bcd7-63a29e7af239 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:01.033328 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1abd1afe-e03c-4d40-bcd7-63a29e7af239 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:01.034119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1abd1afe-e03c-4d40-bcd7-63a29e7af239 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:01.034573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1abd1afe-e03c-4d40-bcd7-63a29e7af239 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:01.035196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1abd1afe-e03c-4d40-bcd7-63a29e7af239 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:01.063732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1abd1afe-e03c-4d40-bcd7-63a29e7af239 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045570 Oct 02 01:15:01.064285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 662/1331] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:02.077010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d77df23-46ab-4e4a-9855-44f3533403fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:02.079204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d77df23-46ab-4e4a-9855-44f3533403fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:02.085640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d77df23-46ab-4e4a-9855-44f3533403fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:02.086163 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d77df23-46ab-4e4a-9855-44f3533403fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:02.086603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d77df23-46ab-4e4a-9855-44f3533403fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:02.087300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d77df23-46ab-4e4a-9855-44f3533403fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:02.087761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d77df23-46ab-4e4a-9855-44f3533403fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:02.088192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d77df23-46ab-4e4a-9855-44f3533403fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:02.116936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d77df23-46ab-4e4a-9855-44f3533403fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 Oct 02 01:15:02.117547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 670/1332] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:03.130908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3e0c389b-0d3b-4835-acc2-f1691529db05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:03.133035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3e0c389b-0d3b-4835-acc2-f1691529db05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:03.139622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e0c389b-0d3b-4835-acc2-f1691529db05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:03.140364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e0c389b-0d3b-4835-acc2-f1691529db05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:03.140799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e0c389b-0d3b-4835-acc2-f1691529db05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:03.141515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e0c389b-0d3b-4835-acc2-f1691529db05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:03.141961 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e0c389b-0d3b-4835-acc2-f1691529db05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:03.142419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e0c389b-0d3b-4835-acc2-f1691529db05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:03.171285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3e0c389b-0d3b-4835-acc2-f1691529db05 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Oct 02 01:15:03.171829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 663/1333] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:04.183783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f08f0016-0c61-4f7d-84f3-17a42cfc97e6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:04.186582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f08f0016-0c61-4f7d-84f3-17a42cfc97e6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:04.192900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f08f0016-0c61-4f7d-84f3-17a42cfc97e6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.193374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f08f0016-0c61-4f7d-84f3-17a42cfc97e6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.193802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f08f0016-0c61-4f7d-84f3-17a42cfc97e6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.194514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f08f0016-0c61-4f7d-84f3-17a42cfc97e6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:04.194963 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f08f0016-0c61-4f7d-84f3-17a42cfc97e6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:04.195383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f08f0016-0c61-4f7d-84f3-17a42cfc97e6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:04.226627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f08f0016-0c61-4f7d-84f3-17a42cfc97e6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Oct 02 01:15:04.227175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 671/1334] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:05.238971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-432bb033-4ced-4162-a5f2-4f59fd6a0d47 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:05.241404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-432bb033-4ced-4162-a5f2-4f59fd6a0d47 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:05.248394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-432bb033-4ced-4162-a5f2-4f59fd6a0d47 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:05.248872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-432bb033-4ced-4162-a5f2-4f59fd6a0d47 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:05.249307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-432bb033-4ced-4162-a5f2-4f59fd6a0d47 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:05.249994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-432bb033-4ced-4162-a5f2-4f59fd6a0d47 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:05.250474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-432bb033-4ced-4162-a5f2-4f59fd6a0d47 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:05.250896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-432bb033-4ced-4162-a5f2-4f59fd6a0d47 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:05.279608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-432bb033-4ced-4162-a5f2-4f59fd6a0d47 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Oct 02 01:15:05.280150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 664/1335] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:06.291996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee62d5b9-8656-4e4a-b5a9-0af34bc71648 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:06.294738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee62d5b9-8656-4e4a-b5a9-0af34bc71648 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:06.301198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee62d5b9-8656-4e4a-b5a9-0af34bc71648 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:06.301670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee62d5b9-8656-4e4a-b5a9-0af34bc71648 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:06.302128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee62d5b9-8656-4e4a-b5a9-0af34bc71648 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:06.302814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee62d5b9-8656-4e4a-b5a9-0af34bc71648 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:06.303261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee62d5b9-8656-4e4a-b5a9-0af34bc71648 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:06.303686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee62d5b9-8656-4e4a-b5a9-0af34bc71648 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:06.332190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee62d5b9-8656-4e4a-b5a9-0af34bc71648 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Oct 02 01:15:06.332733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 672/1336] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:07.344593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aa99fac2-339d-4a96-a355-8e997c47a0f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:07.346747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aa99fac2-339d-4a96-a355-8e997c47a0f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:07.353215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa99fac2-339d-4a96-a355-8e997c47a0f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:07.353692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa99fac2-339d-4a96-a355-8e997c47a0f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:07.354160 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa99fac2-339d-4a96-a355-8e997c47a0f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:07.354853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa99fac2-339d-4a96-a355-8e997c47a0f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:07.355304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa99fac2-339d-4a96-a355-8e997c47a0f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:07.355766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa99fac2-339d-4a96-a355-8e997c47a0f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:07.384663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aa99fac2-339d-4a96-a355-8e997c47a0f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044149 Oct 02 01:15:07.385213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 665/1337] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:08.397701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f146559-726b-40ce-bdbd-a74813b6736b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:08.399860 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f146559-726b-40ce-bdbd-a74813b6736b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:08.406508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f146559-726b-40ce-bdbd-a74813b6736b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:08.406995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f146559-726b-40ce-bdbd-a74813b6736b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:08.407437 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f146559-726b-40ce-bdbd-a74813b6736b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:08.408129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f146559-726b-40ce-bdbd-a74813b6736b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:08.408586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f146559-726b-40ce-bdbd-a74813b6736b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:08.409014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f146559-726b-40ce-bdbd-a74813b6736b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:08.437879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f146559-726b-40ce-bdbd-a74813b6736b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Oct 02 01:15:08.438487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 673/1338] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:08 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:09.451844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ce66b65f-aaf7-4496-948a-52aa7e913d10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:09.454643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ce66b65f-aaf7-4496-948a-52aa7e913d10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:09.461767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce66b65f-aaf7-4496-948a-52aa7e913d10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.462396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce66b65f-aaf7-4496-948a-52aa7e913d10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.463071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce66b65f-aaf7-4496-948a-52aa7e913d10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.463832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce66b65f-aaf7-4496-948a-52aa7e913d10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:09.464290 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce66b65f-aaf7-4496-948a-52aa7e913d10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:09.464717 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ce66b65f-aaf7-4496-948a-52aa7e913d10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:09.494917 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ce66b65f-aaf7-4496-948a-52aa7e913d10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048482 Oct 02 01:15:09.495475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 666/1339] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:10.507038 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef96eb37-9670-4d52-8f4f-c9baf538c16c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:10.509263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef96eb37-9670-4d52-8f4f-c9baf538c16c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:10.516308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef96eb37-9670-4d52-8f4f-c9baf538c16c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:10.516990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef96eb37-9670-4d52-8f4f-c9baf538c16c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:10.517225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef96eb37-9670-4d52-8f4f-c9baf538c16c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:10.517974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef96eb37-9670-4d52-8f4f-c9baf538c16c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:10.518528 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef96eb37-9670-4d52-8f4f-c9baf538c16c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:10.519034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef96eb37-9670-4d52-8f4f-c9baf538c16c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:10.548364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef96eb37-9670-4d52-8f4f-c9baf538c16c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Oct 02 01:15:10.548927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 674/1340] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:11.560714 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7b192938-3a85-4a70-9f3a-5cc0dde5bc6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:11.562889 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7b192938-3a85-4a70-9f3a-5cc0dde5bc6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:11.569224 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b192938-3a85-4a70-9f3a-5cc0dde5bc6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:11.569702 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b192938-3a85-4a70-9f3a-5cc0dde5bc6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:11.570165 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b192938-3a85-4a70-9f3a-5cc0dde5bc6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:11.570856 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b192938-3a85-4a70-9f3a-5cc0dde5bc6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:11.571308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b192938-3a85-4a70-9f3a-5cc0dde5bc6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:11.571730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b192938-3a85-4a70-9f3a-5cc0dde5bc6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:11.601153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7b192938-3a85-4a70-9f3a-5cc0dde5bc6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044430 Oct 02 01:15:11.601694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 667/1341] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:12.613637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6540fc9-2a54-41e0-a2b0-ecaaeabcf878 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:12.616116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6540fc9-2a54-41e0-a2b0-ecaaeabcf878 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:12.622486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6540fc9-2a54-41e0-a2b0-ecaaeabcf878 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:12.622963 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6540fc9-2a54-41e0-a2b0-ecaaeabcf878 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:12.623393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6540fc9-2a54-41e0-a2b0-ecaaeabcf878 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:12.624075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6540fc9-2a54-41e0-a2b0-ecaaeabcf878 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:12.624523 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6540fc9-2a54-41e0-a2b0-ecaaeabcf878 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:12.624946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6540fc9-2a54-41e0-a2b0-ecaaeabcf878 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:12.653493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6540fc9-2a54-41e0-a2b0-ecaaeabcf878 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043300 Oct 02 01:15:12.654039 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 675/1342] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:13.665797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-57b62e14-a55c-4a12-8d1d-6a4d85db49bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:13.667981 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-57b62e14-a55c-4a12-8d1d-6a4d85db49bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:13.675023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b62e14-a55c-4a12-8d1d-6a4d85db49bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.675507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b62e14-a55c-4a12-8d1d-6a4d85db49bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.675941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b62e14-a55c-4a12-8d1d-6a4d85db49bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.676655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b62e14-a55c-4a12-8d1d-6a4d85db49bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:13.677189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b62e14-a55c-4a12-8d1d-6a4d85db49bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:13.677558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57b62e14-a55c-4a12-8d1d-6a4d85db49bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:13.707676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-57b62e14-a55c-4a12-8d1d-6a4d85db49bc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Oct 02 01:15:13.708243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 668/1343] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:14.719784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8dd08325-18cc-4c57-8244-bd636de9b1d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:14.721921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8dd08325-18cc-4c57-8244-bd636de9b1d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:14.728322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dd08325-18cc-4c57-8244-bd636de9b1d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:14.728802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dd08325-18cc-4c57-8244-bd636de9b1d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:14.729240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dd08325-18cc-4c57-8244-bd636de9b1d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:14.729928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dd08325-18cc-4c57-8244-bd636de9b1d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:14.730407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dd08325-18cc-4c57-8244-bd636de9b1d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:14.730828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dd08325-18cc-4c57-8244-bd636de9b1d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:14.760212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8dd08325-18cc-4c57-8244-bd636de9b1d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Oct 02 01:15:14.760750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 676/1344] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:15.772278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cf5fe195-e482-4a04-b34f-247a6441beff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:15.774444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cf5fe195-e482-4a04-b34f-247a6441beff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:15.776741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=30 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:15.781979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5fe195-e482-4a04-b34f-247a6441beff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:15.782499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5fe195-e482-4a04-b34f-247a6441beff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:15.782928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5fe195-e482-4a04-b34f-247a6441beff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:15.783617 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5fe195-e482-4a04-b34f-247a6441beff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:15.784061 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5fe195-e482-4a04-b34f-247a6441beff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:15.784478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5fe195-e482-4a04-b34f-247a6441beff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:15.813046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cf5fe195-e482-4a04-b34f-247a6441beff tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 Oct 02 01:15:15.813585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 669/1345] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:16.824505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31c6ba07-47c0-4880-b89b-6874232af67d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:16.827183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31c6ba07-47c0-4880-b89b-6874232af67d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:16.829603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:16.834961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c6ba07-47c0-4880-b89b-6874232af67d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:16.835449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c6ba07-47c0-4880-b89b-6874232af67d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:16.835890 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c6ba07-47c0-4880-b89b-6874232af67d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:16.836592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c6ba07-47c0-4880-b89b-6874232af67d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:16.837052 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c6ba07-47c0-4880-b89b-6874232af67d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:16.837480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c6ba07-47c0-4880-b89b-6874232af67d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:16.841843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:16.867050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31c6ba07-47c0-4880-b89b-6874232af67d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Oct 02 01:15:16.867600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 677/1346] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:17.879275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a89c6db3-edf5-47a0-bd8f-435b7b476fef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:17.881493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a89c6db3-edf5-47a0-bd8f-435b7b476fef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:17.887995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a89c6db3-edf5-47a0-bd8f-435b7b476fef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.888477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a89c6db3-edf5-47a0-bd8f-435b7b476fef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.888916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a89c6db3-edf5-47a0-bd8f-435b7b476fef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.889608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a89c6db3-edf5-47a0-bd8f-435b7b476fef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:17.890089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a89c6db3-edf5-47a0-bd8f-435b7b476fef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:17.890521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a89c6db3-edf5-47a0-bd8f-435b7b476fef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:17.894090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=90 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:15:17.921044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a89c6db3-edf5-47a0-bd8f-435b7b476fef tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045712 Oct 02 01:15:17.921613 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 670/1347] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:18.933372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a785266-c6b4-4718-a75b-0c205024c810 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:18.936197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a785266-c6b4-4718-a75b-0c205024c810 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:18.942595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a785266-c6b4-4718-a75b-0c205024c810 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.943080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a785266-c6b4-4718-a75b-0c205024c810 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.943518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a785266-c6b4-4718-a75b-0c205024c810 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.944213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a785266-c6b4-4718-a75b-0c205024c810 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:18.944669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a785266-c6b4-4718-a75b-0c205024c810 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:18.945129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a785266-c6b4-4718-a75b-0c205024c810 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:18.973415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a785266-c6b4-4718-a75b-0c205024c810 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Oct 02 01:15:18.973972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 678/1348] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:19.984859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e879a949-5958-4ad1-acf6-25e1f5ad9892 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:19.987078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e879a949-5958-4ad1-acf6-25e1f5ad9892 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:19.994021 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e879a949-5958-4ad1-acf6-25e1f5ad9892 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.994543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e879a949-5958-4ad1-acf6-25e1f5ad9892 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.994977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e879a949-5958-4ad1-acf6-25e1f5ad9892 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:19.995689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e879a949-5958-4ad1-acf6-25e1f5ad9892 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:19.996144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e879a949-5958-4ad1-acf6-25e1f5ad9892 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:19.996599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e879a949-5958-4ad1-acf6-25e1f5ad9892 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:20.025970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e879a949-5958-4ad1-acf6-25e1f5ad9892 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Oct 02 01:15:20.026909 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 671/1349] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:21.038618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0555d1ed-50f1-45a1-9fa9-d4ab47466213 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:21.040767 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0555d1ed-50f1-45a1-9fa9-d4ab47466213 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:21.047830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0555d1ed-50f1-45a1-9fa9-d4ab47466213 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:21.048305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0555d1ed-50f1-45a1-9fa9-d4ab47466213 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:21.048734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0555d1ed-50f1-45a1-9fa9-d4ab47466213 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:21.049416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0555d1ed-50f1-45a1-9fa9-d4ab47466213 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:21.049868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0555d1ed-50f1-45a1-9fa9-d4ab47466213 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:21.050322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0555d1ed-50f1-45a1-9fa9-d4ab47466213 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:21.078129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0555d1ed-50f1-45a1-9fa9-d4ab47466213 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Oct 02 01:15:21.078670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 679/1350] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:22.090570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5d860435-03be-445c-ba34-d5ca8d3ddc29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:22.092724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5d860435-03be-445c-ba34-d5ca8d3ddc29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:22.099072 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d860435-03be-445c-ba34-d5ca8d3ddc29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.099576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d860435-03be-445c-ba34-d5ca8d3ddc29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.100001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d860435-03be-445c-ba34-d5ca8d3ddc29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.100685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d860435-03be-445c-ba34-d5ca8d3ddc29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:22.101131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d860435-03be-445c-ba34-d5ca8d3ddc29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:22.101551 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d860435-03be-445c-ba34-d5ca8d3ddc29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:22.130614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5d860435-03be-445c-ba34-d5ca8d3ddc29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Oct 02 01:15:22.131163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 672/1351] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:23.143782 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4d65a95-3e07-4273-9bfb-447e2326bff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:23.145929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4d65a95-3e07-4273-9bfb-447e2326bff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:23.152411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4d65a95-3e07-4273-9bfb-447e2326bff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:23.152889 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4d65a95-3e07-4273-9bfb-447e2326bff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:23.153321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4d65a95-3e07-4273-9bfb-447e2326bff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:23.154007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4d65a95-3e07-4273-9bfb-447e2326bff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:23.154494 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4d65a95-3e07-4273-9bfb-447e2326bff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:23.154918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4d65a95-3e07-4273-9bfb-447e2326bff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:23.182835 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a4d65a95-3e07-4273-9bfb-447e2326bff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043038 Oct 02 01:15:23.183312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 680/1352] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:24.195902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a683bd5f-3930-489f-82c6-d8691885400a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:24.198004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a683bd5f-3930-489f-82c6-d8691885400a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:24.204878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a683bd5f-3930-489f-82c6-d8691885400a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.205357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a683bd5f-3930-489f-82c6-d8691885400a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.205791 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a683bd5f-3930-489f-82c6-d8691885400a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.206514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a683bd5f-3930-489f-82c6-d8691885400a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:24.206968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a683bd5f-3930-489f-82c6-d8691885400a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:24.207392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a683bd5f-3930-489f-82c6-d8691885400a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:24.238809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a683bd5f-3930-489f-82c6-d8691885400a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046941 Oct 02 01:15:24.239371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 673/1353] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:25.251930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51d43f46-65c6-4fae-93ba-bde1d8f9ec1f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:25.254145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51d43f46-65c6-4fae-93ba-bde1d8f9ec1f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:25.260590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51d43f46-65c6-4fae-93ba-bde1d8f9ec1f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:25.261077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51d43f46-65c6-4fae-93ba-bde1d8f9ec1f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:25.261518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51d43f46-65c6-4fae-93ba-bde1d8f9ec1f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:25.262251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51d43f46-65c6-4fae-93ba-bde1d8f9ec1f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:25.262706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51d43f46-65c6-4fae-93ba-bde1d8f9ec1f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:25.263133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51d43f46-65c6-4fae-93ba-bde1d8f9ec1f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:25.291296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51d43f46-65c6-4fae-93ba-bde1d8f9ec1f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Oct 02 01:15:25.291856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 681/1354] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 02 01:15:26.304362 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-06dced28-2aaf-484a-8b9c-c561c43d2793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:26.306444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-06dced28-2aaf-484a-8b9c-c561c43d2793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:26.313318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06dced28-2aaf-484a-8b9c-c561c43d2793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.313804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06dced28-2aaf-484a-8b9c-c561c43d2793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.314287 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06dced28-2aaf-484a-8b9c-c561c43d2793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.314978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06dced28-2aaf-484a-8b9c-c561c43d2793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:26.315432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06dced28-2aaf-484a-8b9c-c561c43d2793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:26.315859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06dced28-2aaf-484a-8b9c-c561c43d2793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:26.344552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-06dced28-2aaf-484a-8b9c-c561c43d2793 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Oct 02 01:15:26.345097 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 674/1355] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:27.356856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e425ee1-3c4f-45d5-bf08-a41ab45e7b44 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:27.359022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6e425ee1-3c4f-45d5-bf08-a41ab45e7b44 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:27.365696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e425ee1-3c4f-45d5-bf08-a41ab45e7b44 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.366208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e425ee1-3c4f-45d5-bf08-a41ab45e7b44 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.366642 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e425ee1-3c4f-45d5-bf08-a41ab45e7b44 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.367327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e425ee1-3c4f-45d5-bf08-a41ab45e7b44 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:27.367802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e425ee1-3c4f-45d5-bf08-a41ab45e7b44 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:27.368222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e425ee1-3c4f-45d5-bf08-a41ab45e7b44 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:27.396618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e425ee1-3c4f-45d5-bf08-a41ab45e7b44 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Oct 02 01:15:27.397150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 682/1356] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:28.409092 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0fd47a0f-09b1-48a1-a8c8-833c1330329a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:28.411164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0fd47a0f-09b1-48a1-a8c8-833c1330329a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:28.417321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fd47a0f-09b1-48a1-a8c8-833c1330329a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.417798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fd47a0f-09b1-48a1-a8c8-833c1330329a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.418268 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fd47a0f-09b1-48a1-a8c8-833c1330329a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.418952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fd47a0f-09b1-48a1-a8c8-833c1330329a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:28.419401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fd47a0f-09b1-48a1-a8c8-833c1330329a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:28.419821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fd47a0f-09b1-48a1-a8c8-833c1330329a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:28.448273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0fd47a0f-09b1-48a1-a8c8-833c1330329a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Oct 02 01:15:28.448812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 675/1357] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:29.461443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae633648-2f42-4918-8973-04442b59fae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:29.463601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae633648-2f42-4918-8973-04442b59fae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:29.470664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae633648-2f42-4918-8973-04442b59fae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.471148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae633648-2f42-4918-8973-04442b59fae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.471586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae633648-2f42-4918-8973-04442b59fae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.472281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae633648-2f42-4918-8973-04442b59fae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:29.472736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae633648-2f42-4918-8973-04442b59fae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:29.473164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae633648-2f42-4918-8973-04442b59fae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:29.501672 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae633648-2f42-4918-8973-04442b59fae4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Oct 02 01:15:29.502248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 683/1358] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:30.514308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-30fba5ef-33c7-44e4-8369-68a5aa01e00a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:30.516427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-30fba5ef-33c7-44e4-8369-68a5aa01e00a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:30.522802 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30fba5ef-33c7-44e4-8369-68a5aa01e00a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.523275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30fba5ef-33c7-44e4-8369-68a5aa01e00a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.523707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30fba5ef-33c7-44e4-8369-68a5aa01e00a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.524391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30fba5ef-33c7-44e4-8369-68a5aa01e00a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:30.524863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30fba5ef-33c7-44e4-8369-68a5aa01e00a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:30.525285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-30fba5ef-33c7-44e4-8369-68a5aa01e00a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:30.553637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-30fba5ef-33c7-44e4-8369-68a5aa01e00a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 Oct 02 01:15:30.554188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 676/1359] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Oct 2 01:15:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:15:31.566015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9b0231e-44e5-49ff-ab0b-ad1c1465d400 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:15:31.568294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9b0231e-44e5-49ff-ab0b-ad1c1465d400 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:31.575333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b0231e-44e5-49ff-ab0b-ad1c1465d400 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.575802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b0231e-44e5-49ff-ab0b-ad1c1465d400 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.576230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b0231e-44e5-49ff-ab0b-ad1c1465d400 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.576912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b0231e-44e5-49ff-ab0b-ad1c1465d400 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.577359 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b0231e-44e5-49ff-ab0b-ad1c1465d400 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.577779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9b0231e-44e5-49ff-ab0b-ad1c1465d400 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.706778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9b0231e-44e5-49ff-ab0b-ad1c1465d400 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/action" status: 200 len: 83354 microversion: 2.1 time: 0.144432 Oct 02 01:15:31.707419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 684/1360] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Oct 2 01:15:31 2022] POST /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/action => generated 83354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 02 01:15:31.721044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:15:31.721539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:15:31.727972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.728452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.728895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.729586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:15:31.730044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:15:31.730994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:15:31.893853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.objects.instance [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lazy-loading 'services' on Instance uuid bcf3492e-1bdf-44e5-a0dc-e15824c17792 {{(pid=120424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 02 01:15:31.948090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f29e5a-909a-4f02-8b97-1cdfe2e0654a) Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Request method failure captured: Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments/7091bbe8-0989-4d3e-8f30-ee0a64181bc3 HTTP/1.1 Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOQxQOonmYEMm32yusW1WrHqqvT2k15nPylOyFrVzVzANsh8c6mckJjwTlEzCqOnS9qxNz7ti7UHViBIzIhY-7r7yB2QXWJe43ne3j_wO_q3oozDv4WP378An2wRSQyAQlLW459jzbf9_Yoryg6wE226sMOGqm81exYpMqTeuIEIqKg Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: ff4a21c5f4b04110b2fa42a2bba32348 Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-TestMinimumBasicScenario-818184896 Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:15:31.950445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4a21c5f4b04110b2fa42a2bba32348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff4a21c5f4b04110b2fa42a2bba32348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff4a21c5f4b04110b2fa42a2bba32348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff4a21c5f4b04110b2fa42a2bba32348"}]}] Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-TestMinimumBasicScenario-818184896 Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: ff4a21c5f4b04110b2fa42a2bba32348 Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-TestMinimumBasicScenario-818184896 Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-TestMinimumBasicScenario-818184896-project Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: 47e0ae04969b4f7684cb21edaaa85b55 Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-TestMinimumBasicScenario-818184896-project Oct 02 01:15:31.952260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f29e5a-909a-4f02-8b97-1cdfe2e0654a) Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'server_id': 'bcf3492e-1bdf-44e5-a0dc-e15824c17792', 'id': '7091bbe8-0989-4d3e-8f30-ee0a64181bc3'} Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Oct 02 01:15:31.953048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f29e5a-909a-4f02-8b97-1cdfe2e0654a) Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 02 01:15:31.954360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f29e5a-909a-4f02-8b97-1cdfe2e0654a) Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:31.955703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f29e5a-909a-4f02-8b97-1cdfe2e0654a) Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:31.956942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f29e5a-909a-4f02-8b97-1cdfe2e0654a) Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f29e5a-909a-4f02-8b97-1cdfe2e0654a) Oct 02 01:15:31.958494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:15:31.960197 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f29e5a-909a-4f02-8b97-1cdfe2e0654a) {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:15:31.960197 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-52dcf22d-2e9c-4ce9-b789-b69a2026f69d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments/7091bbe8-0989-4d3e-8f30-ee0a64181bc3" status: 400 len: 269 microversion: 2.1 time: 0.234933 Oct 02 01:15:31.960197 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 677/1361] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Oct 2 01:15:31 2022] DELETE /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792/os-volume_attachments/7091bbe8-0989-4d3e-8f30-ee0a64181bc3 => generated 269 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 02 01:19:40.377154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf55bc6a-1cc6-42a9-b65b-b1c4dd695e6c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 02 01:19:40.379129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7b0bf21-a119-4ff9-ad09-f3d084f67fbf] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 01:19:40.379681 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 01:19:40.379853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 02 01:19:40.382472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:19:40.382622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd (ip 10.222.0.25) !!! Oct 02 01:19:40.384337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 01:19:40.384479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 02 01:19:40.386607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 01:19:40.386732 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd (ip 10.222.0.25) !!! Oct 02 01:19:40.388259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=17 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:40.389181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=49 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:40.389872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:19:40.390820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=15 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:40.391761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=45 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:19:40.392692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 02 01:19:40.394972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 01:19:40.395108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd (ip 10.222.0.25) !!! Oct 02 01:19:40.404511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:40.406205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:40.437975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.438396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.439045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.439746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.440196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.440618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.470288 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:19:40.471886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-6fdc3ed9-10a9-4b82-9ddc-0cabf4c5bc1d req-6ee6a9de-68f2-4a3f-895f-9891f6228116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20234809-0f73-4a21-a8ab-08a7715c83fd", "tag": "49b1bf72-665b-4d49-b376-5134dc334f5c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:40.481618 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6fdc3ed9-10a9-4b82-9ddc-0cabf4c5bc1d req-6ee6a9de-68f2-4a3f-895f-9891f6228116 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.482179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6fdc3ed9-10a9-4b82-9ddc-0cabf4c5bc1d req-6ee6a9de-68f2-4a3f-895f-9891f6228116 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.482561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-6fdc3ed9-10a9-4b82-9ddc-0cabf4c5bc1d req-6ee6a9de-68f2-4a3f-895f-9891f6228116 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.494586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-6fdc3ed9-10a9-4b82-9ddc-0cabf4c5bc1d req-6ee6a9de-68f2-4a3f-895f-9891f6228116 service nova] Creating event network-changed:49b1bf72-665b-4d49-b376-5134dc334f5c for instance 20234809-0f73-4a21-a8ab-08a7715c83fd on hv-cinder-maste Oct 02 01:19:40.501087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-6fdc3ed9-10a9-4b82-9ddc-0cabf4c5bc1d req-6ee6a9de-68f2-4a3f-895f-9891f6228116 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125421 Oct 02 01:19:40.502081 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 678/1362] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:40.555902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27e88fc0-cda0-489b-b362-b7b00d485d3e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 204 len: 0 microversion: 2.1 time: 0.180833 Oct 02 01:19:40.556516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 685/1363] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:19:40 2022] DELETE /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:19:40.577073 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:40.577777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:40.584100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.584588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.585025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.585726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:40.586283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:40.586714 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:40.717496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:40.725865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-35e25794-1227-48b8-b60b-bf944ae7cec3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1577 microversion: 2.1 time: 0.154641 Oct 02 01:19:40.726461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 679/1364] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:40 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:41.750622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:41.751333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:41.762993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7b0bf21-a119-4ff9-ad09-f3d084f67fbf] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37794. Oct 02 01:19:41.767299 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:41.767886 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:41.768330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:41.769232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:41.769697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:41.770152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:42.086748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:42.095882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f7ab7fd-4bfe-4c71-ba03-55ecf66e8877 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1577 microversion: 2.1 time: 0.349419 Oct 02 01:19:42.096779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 686/1365] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:41 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1577 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:42.516145 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-fb68b718-af3c-4ebb-b1ab-cd10d078fcb9 req-23783015-72d3-47f7-b55f-d0109d13fb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20234809-0f73-4a21-a8ab-08a7715c83fd", "name": "network-vif-deleted", "tag": "49b1bf72-665b-4d49-b376-5134dc334f5c"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:19:42.527957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-fb68b718-af3c-4ebb-b1ab-cd10d078fcb9 req-23783015-72d3-47f7-b55f-d0109d13fb54 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:42.528435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-fb68b718-af3c-4ebb-b1ab-cd10d078fcb9 req-23783015-72d3-47f7-b55f-d0109d13fb54 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:42.528866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-fb68b718-af3c-4ebb-b1ab-cd10d078fcb9 req-23783015-72d3-47f7-b55f-d0109d13fb54 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:42.542948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-fb68b718-af3c-4ebb-b1ab-cd10d078fcb9 req-23783015-72d3-47f7-b55f-d0109d13fb54 service nova] Creating event network-vif-deleted:49b1bf72-665b-4d49-b376-5134dc334f5c for instance 20234809-0f73-4a21-a8ab-08a7715c83fd on hv-cinder-maste Oct 02 01:19:42.546398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf55bc6a-1cc6-42a9-b65b-b1c4dd695e6c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37802. Oct 02 01:19:42.548119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-fb68b718-af3c-4ebb-b1ab-cd10d078fcb9 req-23783015-72d3-47f7-b55f-d0109d13fb54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035814 Oct 02 01:19:42.548939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 680/1366] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:19:43.120730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:43.121349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:43.127824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:43.128308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:43.128749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:43.129442 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:43.130411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:43.130843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:43.190180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:43.198383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8607fe94-59d7-4ce8-9cb0-4eb922117ab3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081517 Oct 02 01:19:43.198944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 687/1367] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:43 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:44.222589 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:44.223250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:44.230083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:44.230573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:44.231008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:44.231696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:44.232148 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:44.232575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:44.296526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:44.304427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-62aa0e05-6565-47e8-a2af-854163442b1a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.086514 Oct 02 01:19:44.304994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 681/1368] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:44 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:45.326646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:45.327218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:45.333653 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:45.334169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:45.334607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:45.335299 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:45.335758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:45.336193 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:45.396136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:45.404016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c388efb-338b-42e8-9e8e-6d7e47d9cdb8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081203 Oct 02 01:19:45.404585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 688/1369] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:45 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:46.426558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:46.427629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:46.433911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:46.434414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:46.434851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:46.435536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:46.435983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:46.436406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:46.499676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:46.508308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-292f124b-f7be-4297-b3da-f62a3ade0090 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085594 Oct 02 01:19:46.508887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 682/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:46 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:47.531608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:47.532277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:47.538760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:47.539243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:47.539681 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:47.540373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:47.540828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:47.541283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:47.600550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:47.608028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-545a1bd4-dbac-4332-8483-fa4ac2d68083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080272 Oct 02 01:19:47.608593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 689/1371] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:47 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:48.631691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:48.632304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:48.638767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:48.639250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:48.639686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:48.640375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:48.640829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:48.641256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:48.702502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:48.710153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e8a8641e-1bc0-4ad7-b1e0-af328f588e2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082861 Oct 02 01:19:48.710713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 683/1372] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:48 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:49.732643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:49.733190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:49.739885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:49.740368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:49.740804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:49.741497 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:49.741953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:49.742404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:49.801409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:49.809117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-97a82977-b52f-4e2f-97c0-e71539f00d0f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080425 Oct 02 01:19:49.809674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 690/1373] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:49 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:50.832031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:50.833168 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:50.839680 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:50.840164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:50.840606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:50.841300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:50.841755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:50.842211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:50.901962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:50.909632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d926df22-ca00-491c-8ffa-ca75336579b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081420 Oct 02 01:19:50.910222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 684/1374] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:50 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:51.933239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:51.933847 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:51.940342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:51.940818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:51.941248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:51.941960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:51.942432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:51.942847 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:52.004898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:52.012515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e92aeb1-9135-4290-a6b3-601eb4b2f3d2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083058 Oct 02 01:19:52.013080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 691/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:51 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:53.035547 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:53.036193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:53.042800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:53.043284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:53.043722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:53.044416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:53.044885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:53.045296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:53.107902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:53.116240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4aaab1a3-e6fa-4666-a4fa-80ed7203bf8b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084594 Oct 02 01:19:53.116804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 685/1376] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:53 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:54.140121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:54.140725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:54.147765 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:54.148233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:54.148713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:54.149340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:54.149784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:54.150232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:54.210102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:54.217769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2c1df6f-136a-46ca-b479-d638373d22c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081471 Oct 02 01:19:54.218359 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 692/1377] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:54 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:55.241331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:55.241933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:55.248366 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:55.248841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:55.249272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:55.249950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:55.250425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:55.250846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:55.312271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:55.319921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f33affe1-0f5e-4aa6-a9c0-aa9e3b21f923 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083332 Oct 02 01:19:55.320477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 686/1378] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:55 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:56.342466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:56.343006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:56.349834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:56.350325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:56.350751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:56.351425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:56.351900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:56.352317 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:56.411332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:56.418950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a0aa99c-f8fa-49db-9783-5db621d0497b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080374 Oct 02 01:19:56.419499 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 693/1379] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:56 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:57.442841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:57.443519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:57.450093 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:57.450571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:57.451006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:57.451700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:57.452154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:57.452578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:57.515269 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:57.523074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-af5dfc1b-c3ec-4210-a15f-1a479576ab9b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084621 Oct 02 01:19:57.523647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 687/1380] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:57 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:58.545570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:58.546208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:58.553053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:58.553522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:58.553951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:58.554650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:58.555098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:58.555513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:58.615431 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:58.623048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae04a161-22d0-4a4e-8cd5-ddb3efe69f3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081342 Oct 02 01:19:58.623599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 694/1381] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:58 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:19:59.646324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:19:59.646901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:19:59.653196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:59.653682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:59.654154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:59.654853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:19:59.655309 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:19:59.655739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:19:59.715283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:19:59.722819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-12ec24da-bb9b-4dfc-acb5-cfaa60ab6a7c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081095 Oct 02 01:19:59.723418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 688/1382] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:19:59 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:00.746216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:00.746834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:00.753239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:00.753714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:00.754176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:00.754869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:00.755321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:00.755742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:00.814772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:00.822312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a9a36419-0c7b-4145-af93-55e1c1e21810 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080003 Oct 02 01:20:00.822873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 695/1383] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:00 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:01.845352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:01.845994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:01.852506 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:01.852986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:01.853419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:01.854129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:01.854585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:01.855011 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:01.917236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:01.924900 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-779cf3a2-3730-48f6-8434-f3e4b414f590 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083397 Oct 02 01:20:01.925470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 689/1384] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:01 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:02.946933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:02.947545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:02.954139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:02.954619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:02.955053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:02.955737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:02.956190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:02.956612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:03.263658 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:03.272033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3e3c0bfb-f564-4c1a-89bc-c8760057ac89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.329010 Oct 02 01:20:03.272605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 696/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:02 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:04.294673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:04.295314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:04.301722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:04.302245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:04.302685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:04.303377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:04.303827 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:04.304254 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:04.363853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:04.371534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-05d3f8e4-282f-4963-adba-8dff557d0ce7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080722 Oct 02 01:20:04.372091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 690/1386] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:04 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:05.394250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:05.394863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:05.401230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:05.401711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:05.402187 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:05.402887 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:05.403340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:05.403771 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:05.466331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:05.474713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c34edcf-1e8d-4359-a69a-6b8ff4dbac60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084360 Oct 02 01:20:05.475276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 697/1387] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:05 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:06.497751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:06.498394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:06.505392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:06.505868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:06.506400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:06.507090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:06.507544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:06.507966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:06.567550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:06.575171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fb21a6bc-57ed-46d5-98c8-d39738136c55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081258 Oct 02 01:20:06.575728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 691/1388] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:06 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:07.598629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:07.599252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:07.605643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:07.606144 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:07.606579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:07.607260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:07.607781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:07.608149 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:07.667824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:07.675459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19a27224-8aac-4122-a8a4-1c2c9cea1fcd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081358 Oct 02 01:20:07.676030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 698/1389] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:07 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:08.698248 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:08.698795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:08.705182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:08.705666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:08.706131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:08.706832 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:08.707288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:08.707717 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:08.768347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:08.776539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e76782f2-cfe8-4681-855f-8d94ec29a53c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082283 Oct 02 01:20:08.777100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 692/1390] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:08 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:09.799913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:09.801385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:09.808454 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:09.808934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:09.809366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:09.810083 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:09.810535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:09.810991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:09.872248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:09.875577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:09.880271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cbdf0230-84c3-4129-afa6-28ef65f0fd45 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084536 Oct 02 01:20:09.880828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 699/1391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:09 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:10.902334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:10.903000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:10.905206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=31 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:10.910543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:10.911028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:10.911466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:10.912191 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:10.912643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:10.913067 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:10.917083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=83 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:10.978520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:10.987077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1b574202-e682-4ba5-85e2-722cba7d6fab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.087942 Oct 02 01:20:10.987686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 693/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:10 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:12.011736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:12.012333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:12.014298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:12.020693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:12.021169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:12.021598 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:12.022311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:12.022758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:12.023180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:12.085180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:12.092802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-494bbb27-0d7f-4bb1-9c3e-fb0616919181 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085327 Oct 02 01:20:12.093355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 700/1393] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:12 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:13.116069 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:13.116676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:13.122901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:13.123375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:13.123803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:13.124481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:13.124924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:13.125339 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:13.186610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:13.194262 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-51b2ab47-4a9f-4959-88ce-e4c03d08825f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082883 Oct 02 01:20:13.194825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 694/1394] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:13 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:14.216664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:14.217266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:14.224425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:14.224906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:14.225335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:14.226018 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:14.226489 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:14.226906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:14.289534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:14.297251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ef8ea8d-55f0-4577-95d0-aad2721db2d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084456 Oct 02 01:20:14.297808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 701/1395] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:14 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:15.320126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:15.320659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:15.327090 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:15.327569 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:15.328006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:15.328692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:15.329178 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:15.329599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:15.392673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:15.400489 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c9e1f502-128d-4bea-b629-8f411b2d4358 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084280 Oct 02 01:20:15.401058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 695/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:15 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:16.423574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:16.424116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:16.431049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:16.431529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:16.431957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:16.432638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:16.433085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:16.433504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:16.493015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:16.500625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f7f6537e-fb5d-4479-add3-0e8f43719574 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080995 Oct 02 01:20:16.501185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 702/1397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:16 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:17.523878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:17.524482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:17.530824 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:17.531300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:17.531730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:17.532445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:17.532895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:17.533318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:17.592840 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:17.600478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-68901f1f-4faf-4760-8f22-06450a3676d3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081072 Oct 02 01:20:17.601043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 696/1398] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:17 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:18.623347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:18.623958 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:18.630617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.631090 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.631521 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.632200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:18.632648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:18.633067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:18.692040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:18.699633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ec6bee63-e226-4914-94ea-a0e3713f9b94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080165 Oct 02 01:20:18.700185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 703/1399] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:18 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:19.728111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:19.728654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:19.734968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:19.735453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:19.735884 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:19.736565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:19.737009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:19.737427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:19.801249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:19.808922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b515d599-81f2-4ed3-a009-d975e93b202d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084710 Oct 02 01:20:19.809481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 697/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:19 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:20.831581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:20.832195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:20.839284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:20.839770 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:20.840204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:20.840895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:20.841350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:20.841773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:20.903475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:20.911316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-280241c7-7337-492c-b2eb-258f157063c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083610 Oct 02 01:20:20.911885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 704/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:20 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:21.934500 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:21.935117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:21.941928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:21.942434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:21.942865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:21.943545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:21.943990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:21.944410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:22.004807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:22.012464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bf457d91-4aa7-46c1-b427-62ee0d28abf0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081790 Oct 02 01:20:22.013030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 698/1402] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:21 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:23.036856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:23.037303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:23.043730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:23.044202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:23.044660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:23.045340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:23.045789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:23.046246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:23.107083 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:23.114994 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9cc64917-2aba-4995-8172-c9b6770d819e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082768 Oct 02 01:20:23.115558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 705/1403] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:23 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:24.137492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:24.138151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:24.144866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:24.145361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:24.145802 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:24.146532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:24.146994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:24.147421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:24.211462 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:24.219249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d321c9cf-83bb-4604-b51f-000b3546d9c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085671 Oct 02 01:20:24.219821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 699/1404] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:24 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:25.243132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:25.243746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:25.250411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:25.250892 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:25.251359 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:25.252086 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:25.252536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:25.252962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:25.313601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:25.321836 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0773f213-9a2a-434a-80ab-59432856b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083081 Oct 02 01:20:25.322427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 706/1405] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:25 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:26.344074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:26.344690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:26.351184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:26.351665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:26.352108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:26.352797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:26.353251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:26.353676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:26.416710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:26.424303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7aba9546-b0b9-4cb4-a829-db4dfad634b6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084175 Oct 02 01:20:26.424868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 700/1406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:26 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:27.446525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:27.447139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:27.453433 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:27.453912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:27.454385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:27.455077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:27.455530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:27.455955 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:27.515349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:27.523447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75f9c6fc-8108-4108-a06d-6fd03711968f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080725 Oct 02 01:20:27.524008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 707/1407] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:27 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:28.546990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:28.547602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:28.554522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:28.554998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:28.555427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:28.556111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:28.556556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:28.556982 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:28.620189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:28.627933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-42fd2336-0b32-4af1-946f-8d6cfb079ee0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084694 Oct 02 01:20:28.628436 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 701/1408] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:28 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:29.651091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:29.651621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:29.658114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:29.658593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:29.659028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:29.659714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:29.660170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:29.660781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:29.722535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:29.730188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3565099d-282c-46ac-93a4-089f77c68b88 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083026 Oct 02 01:20:29.730752 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 708/1409] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:29 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:30.753229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:30.753841 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:30.760209 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:30.760683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:30.761116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:30.761795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:30.762276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:30.762697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:30.823894 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:30.831990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-83e0f993-0c63-4095-95b0-36284eb19be2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082599 Oct 02 01:20:30.833102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 702/1410] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:30 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:31.855119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:31.855725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:31.862174 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:31.862897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:31.863328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:31.864600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:31.865047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:31.865466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:31.928062 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:31.935605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a43c9329-806e-48b7-bb0d-a79d228822ed tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084311 Oct 02 01:20:31.936157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 709/1411] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:31 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:32.958806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:32.959380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:32.965806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:32.966329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:32.966774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:32.967474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:32.967938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:32.968371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:33.076163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:33.084829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f2996f51-1836-4f10-832c-b789f7f495ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.130503 Oct 02 01:20:33.085396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 703/1412] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:32 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:34.107659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:34.108281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:34.115641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:34.116120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:34.116554 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:34.117272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:34.117730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:34.118185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:34.178277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:34.185857 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d401b7b9-96d8-4641-8e31-cd91598c827f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082124 Oct 02 01:20:34.186515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 710/1413] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:34 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:35.208390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:35.209000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:35.215501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:35.215978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:35.216410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:35.217091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:35.217572 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:35.217988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:35.277566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:35.285219 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ccf1ba2c-426d-42af-ab8a-941d57337510 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080649 Oct 02 01:20:35.285816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 704/1414] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:35 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:36.307691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:36.308234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:36.314779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:36.315263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:36.315699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:36.316919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:36.317371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:36.317796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:36.379553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:36.387161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9150f6ea-b6c3-4113-ab29-c1d08abd79a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083412 Oct 02 01:20:36.387730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 711/1415] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:36 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:37.410674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:37.411320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:37.417831 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:37.418355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:37.418796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:37.419494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:37.419949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:37.420379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:37.483991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:37.491694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b2f95b14-a6f7-4749-96b4-25df18fc5c3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085555 Oct 02 01:20:37.492266 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 705/1416] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:37 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:38.514227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:38.514847 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:38.521246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:38.521726 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:38.522196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:38.522894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:38.523359 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:38.523785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:38.583867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:38.591577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5bb731e2-e28e-46bb-9a78-8a44fb880d7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081297 Oct 02 01:20:38.592140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 712/1417] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:38 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:39.615449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:39.616058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:39.622429 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:39.622904 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:39.623334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:39.624073 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:39.624465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:39.624886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:39.686489 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:39.694830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c71c6ef0-73a4-4fb9-9272-94f132ac2f4e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083994 Oct 02 01:20:39.695389 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 706/1418] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:39 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:40.717976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:40.718627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:40.725067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:40.725546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:40.725981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:40.726696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:40.727148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:40.727571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:40.786904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:40.794382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9b81470-b92e-407e-a05d-decaf7f4fd74 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080263 Oct 02 01:20:40.794943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 713/1419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:40 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:41.816730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:41.817335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:41.819662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=28 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:41.824993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:41.825464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:41.825898 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:41.826614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:41.827068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:41.827491 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:41.831505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=84 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:41.890434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:41.898720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0d6fdb7c-5855-4ffc-aac6-2a52ddc117a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085897 Oct 02 01:20:41.899274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 707/1420] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:41 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:42.922263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:42.922881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:42.924764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=28 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:42.929922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:42.930428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:42.930864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:42.931551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:42.932004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:42.932427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:42.936480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=85 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:20:42.992543 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:43.000280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f71f7dbb-b6b4-4f90-8955-582cd4c514a2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082098 Oct 02 01:20:43.000849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 714/1421] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:42 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:44.023348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:44.023955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:44.030346 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:44.030837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:44.031272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:44.031975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:44.032456 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:44.032878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:44.094314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:44.102514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e3732586-062a-4a80-9784-846a68502d7e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083649 Oct 02 01:20:44.103074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 708/1422] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:44 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:45.124788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:45.125402 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:45.132289 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:45.132770 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:45.133208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:45.133901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:45.134379 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:45.134807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:45.195011 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:45.202701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5a22524-abb5-4c5a-9876-4181fc16bffa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081797 Oct 02 01:20:45.203270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 715/1423] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:45 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:46.225225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:46.225833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:46.232819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:46.233298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:46.233730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:46.234443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:46.234892 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:46.235313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:46.298039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:46.306219 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4ce555e5-5e38-4859-b0f6-bf61dbaa0f5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084848 Oct 02 01:20:46.306774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 709/1424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:46 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:47.328575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:47.329142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:47.336307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:47.336787 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:47.337230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:47.337919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:47.338403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:47.338830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:47.399069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:47.406927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee5c1bc8-7a0f-4678-8e29-e0af7661a6ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082297 Oct 02 01:20:47.407496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 716/1425] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:47 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:48.430104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:48.430758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:48.437085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:48.437558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:48.437988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:48.438695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:48.439144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:48.439561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:48.500403 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:48.508064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-81dc3286-a670-41c3-b076-773b763124bf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082572 Oct 02 01:20:48.508618 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 710/1426] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:48 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:49.530677 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:49.531285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:49.537685 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:49.538209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:49.538665 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:49.539351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:49.539793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:49.540211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:49.604504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:49.612262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da327e52-1b71-4b0a-aead-2faccf21464e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085419 Oct 02 01:20:49.613715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 717/1427] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:49 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:50.635524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:50.636135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:50.642628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:50.643111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:50.643546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:50.644971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:50.645421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:50.645842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:50.707359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:50.714941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4cb7c123-ddff-4fc5-9722-66120d810434 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083261 Oct 02 01:20:50.715525 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 711/1428] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:50 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:51.736919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:51.737841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:51.744472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:51.744961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:51.745397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:51.746133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:51.746591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:51.747016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:51.808468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:51.816597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7b56436-314e-47fb-b8ba-ad7a623beec1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083481 Oct 02 01:20:51.817159 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 718/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:51 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:52.839926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:52.840545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:52.847442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:52.847923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:52.848357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:52.849046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:52.849498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:52.849922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:52.910169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:52.917729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d12bab27-2116-4159-9fcf-0c62437e6e16 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081631 Oct 02 01:20:52.918320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 712/1430] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:52 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:53.942563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:53.943172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:53.949399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:53.949875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:53.950351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:53.951034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:53.951484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:53.951902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:54.012078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:54.019632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ba946ac-1a6b-4c49-b728-0154919e3046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081695 Oct 02 01:20:54.020193 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 719/1431] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:53 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:55.042095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:55.042713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:55.049141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:55.049561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:55.049989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:55.050769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:55.051216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:55.051634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:55.115733 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:55.123314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4c3868c7-f013-4553-aeb3-d690b83b8b3a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085083 Oct 02 01:20:55.123875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 713/1432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:55 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:56.146551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:56.147095 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:56.153489 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:56.153962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:56.154432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:56.155109 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:56.155553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:56.155970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:56.215314 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:56.223524 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-46afa11c-eb4a-42a0-b254-79efbfb98d33 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081402 Oct 02 01:20:56.224080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 720/1433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:56 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:20:57.245876 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:57.246547 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:57.252987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:57.253465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:57.253899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:57.254627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:57.255079 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:57.255499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:57.314663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:57.322409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f203c114-906a-4489-807d-e84249911977 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080357 Oct 02 01:20:57.322970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 714/1434] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:57 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:58.344697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:58.345309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:58.351822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:58.352299 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:58.352733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:58.353425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:58.353888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:58.354337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:58.413678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:58.421309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb2acb41-8344-42e7-844c-b4e5a4b5a785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080480 Oct 02 01:20:58.421862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 721/1435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:58 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:20:59.444880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:20:59.445510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:20:59.451980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:59.452463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:59.452898 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:59.453588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:20:59.454041 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:20:59.454484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:20:59.517029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:20:59.525334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3b3d839d-8ca3-4272-ac4a-9c4129f223fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084911 Oct 02 01:20:59.525907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 715/1436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:20:59 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:00.547577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:00.548191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:00.554693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:00.555171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:00.555605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:00.556292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:00.556746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:00.557171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:00.616680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:00.624345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00d5586b-994e-40b0-a474-1d2c690ce1eb tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080602 Oct 02 01:21:00.624899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 722/1437] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:00 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:01.647343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:01.647899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:01.654375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:01.654855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:01.655292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:01.655982 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:01.656436 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:01.656859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:01.716315 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:01.723851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ed105d80-7034-4a04-8984-a27613510b89 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080977 Oct 02 01:21:01.724410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 716/1438] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:01 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:02.745670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:02.746311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:02.753458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:02.753941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:02.754409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:02.755098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:02.755551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:02.755977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:02.814483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:02.822771 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e74b069a-1f94-49a5-ac7a-7ce6b0f98008 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080966 Oct 02 01:21:02.823330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 723/1439] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:02 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:03.845356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:03.845965 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:03.852350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:03.852820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:03.853247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:03.853926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:03.854394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:03.854815 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:03.917279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:03.925044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7ef25230-9ca8-4d68-a6c9-7bc5c60b7339 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083588 Oct 02 01:21:03.925630 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 717/1440] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:03 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:04.947558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:04.948146 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:04.954662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:04.955145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:04.955579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:04.956759 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:04.957209 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:04.957635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:05.019890 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:05.027527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65be245e-68e1-4a12-beb7-c161f90d3800 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083820 Oct 02 01:21:05.028333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 724/1441] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:04 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:06.050495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:06.051098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:06.057243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:06.057728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:06.058180 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:06.058899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:06.059347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:06.059771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:06.137950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:06.145823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9ee74028-b436-49db-a93a-53cc25be2074 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.099723 Oct 02 01:21:06.146414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 718/1442] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:06 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:07.168798 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:07.169409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:07.175865 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:07.176362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:07.176769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:07.177461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:07.177913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:07.178364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:07.239163 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:07.246850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d27f7f5-b86d-43a9-9eeb-27e57c510d6b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082028 Oct 02 01:21:07.247411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 725/1443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:07 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:08.270625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:08.271237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:08.277673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:08.278186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:08.278621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:08.279333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:08.279783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:08.280204 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:08.343896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:08.351658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d6675669-48c4-40da-ad51-1c2fc54a39d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085397 Oct 02 01:21:08.352214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 719/1444] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:08 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:09.375276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:09.375898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:09.382295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:09.382772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:09.383202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:09.383887 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:09.384331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:09.384814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:09.446596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:09.454363 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94476b1c-950a-4730-8aa9-8e584fbd8320 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083010 Oct 02 01:21:09.455166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 726/1445] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:09 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:10.478527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:10.479095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:10.485457 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:10.485942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:10.486403 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:10.488132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:10.488584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:10.489002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:10.550699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:10.558574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eeec57ef-1a9b-4ceb-bb75-4cdbc7b7b99c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084133 Oct 02 01:21:10.559134 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 720/1446] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:10 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:11.582220 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:11.582765 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:11.589099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:11.589571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:11.590000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:11.590703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:11.591150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:11.591570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:11.650953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:11.658461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2235fe1a-27ae-4f23-9858-2b7aef5ca761 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080719 Oct 02 01:21:11.659067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 727/1447] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:11 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:12.680868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:12.681482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:12.683511 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=28 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:12.688809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:12.689285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:12.689742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:12.690452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:12.690901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:12.691320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:12.695308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=84 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:12.759442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:12.767088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-35bbf35c-7de7-4b38-8949-f31aac1da902 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.090038 Oct 02 01:21:12.767648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 721/1448] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:12 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:13.792612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:13.793204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:13.795255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=28 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:13.801212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:13.801691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:13.802163 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:13.802858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:13.803312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:13.803738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:13.807601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=84 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:13.864366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:13.872212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7fe28950-2bca-410f-b09b-5c77b198babf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083462 Oct 02 01:21:13.872782 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 728/1449] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:13 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:14.895520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:14.896126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:14.902550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:14.903028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:14.903458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:14.904143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:14.904591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:14.905010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:14.966898 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:14.975174 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-794c44e0-3d64-446e-a15e-e93c5f2d205e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084092 Oct 02 01:21:14.975755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 722/1450] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:14 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:15.998377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:15.998980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:16.005377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:16.005853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:16.006316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:16.007002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:16.007449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:16.007868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:16.068055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:16.075690 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-592bf02e-fe09-4534-8e11-e43dcd3e99a6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081086 Oct 02 01:21:16.076251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 729/1451] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:15 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:17.098554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:17.099179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:17.105632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:17.106153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:17.106619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:17.107321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:17.107805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:17.108235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:17.170621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:17.178393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-35533a0e-6a69-4a8f-9d4f-3a9e515d0827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084341 Oct 02 01:21:17.178956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 723/1452] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:17 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:18.200855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:18.201470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:18.207930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:18.208412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:18.208849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:18.209546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:18.209999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:18.210452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:18.269863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:18.277578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dade64a6-527c-4c54-8187-f1c13f4d2d6f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080691 Oct 02 01:21:18.278162 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 730/1453] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:18 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:19.301299 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:19.301874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:19.308402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:19.308877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:19.309308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:19.309991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:19.310483 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:19.310904 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:19.370988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:19.379846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-564cfacf-097c-4112-a3db-ffd3914ad225 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082999 Oct 02 01:21:19.380417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 724/1454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:19 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:20.402171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:20.402698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:20.409145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:20.409618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:20.410049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:20.410754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:20.411199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:20.411618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:20.474862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:20.482588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cc00e3ce-571c-4674-b997-ad037ea72c41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084286 Oct 02 01:21:20.483153 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 731/1455] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:20 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:21.505240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:21.505852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:21.513068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:21.513544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:21.513979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:21.514694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:21.515144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:21.515566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:21.577015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:21.585186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4cbd2bf2-39d0-4675-9858-8b6f0e77c927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083785 Oct 02 01:21:21.585748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 725/1456] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:21 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:22.608219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:22.608745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:22.616212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:22.616717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:22.617143 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:22.617823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:22.618301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:22.618715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:22.677417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:22.684976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34b5f276-2d01-4cca-b06f-5369b8db7017 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080655 Oct 02 01:21:22.685527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 732/1457] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:22 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:23.709348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:23.709915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:23.716437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:23.716916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:23.717349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:23.718042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:23.718518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:23.718938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:23.779495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:23.787096 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-482c1e69-00fb-48d8-9d74-a5f831f4de0d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083599 Oct 02 01:21:23.787649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 726/1458] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:23 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:24.810311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:24.810927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:24.817853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:24.818372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:24.818808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:24.819498 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:24.819951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:24.820379 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:24.879835 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:24.887464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-592d4268-a93a-48b0-ab20-1aa26a7fb299 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081076 Oct 02 01:21:24.888025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 733/1459] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:24 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:25.911264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:25.911907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:25.918368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:25.918845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:25.919275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:25.919966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:25.920415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:25.920835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:25.984878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:25.993056 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-64a47702-9be5-472f-8f6b-18759aaf947b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.086100 Oct 02 01:21:25.993614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 727/1460] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:25 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:27.015579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:27.016192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:27.023429 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:27.023910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:27.024340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:27.025190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:27.029719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:27.029719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:27.088204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:27.095663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ddc76826-f9ce-4005-851d-179af65f8827 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083961 Oct 02 01:21:27.096225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 734/1461] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:27 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:28.118908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:28.119618 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:28.125963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:28.126471 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:28.126904 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:28.127585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:28.128038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:28.128456 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:28.188934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:28.196723 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fe1aeb9a-8400-4d0f-8d85-061f95d823be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081648 Oct 02 01:21:28.197276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 728/1462] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:28 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:29.219172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:29.219783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:29.226197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:29.227000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:29.227434 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:29.228115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:29.228563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:29.228982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:29.288590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:29.296261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e06a56f3-758e-492a-9c4c-df232186beef tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080898 Oct 02 01:21:29.296816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 735/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:29 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:30.319391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:30.319926 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:30.326413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:30.326893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:30.327333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:30.328002 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:30.328454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:30.328873 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:30.391974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:30.400376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1345bea1-b916-48d4-b87b-56277cc1695b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085384 Oct 02 01:21:30.400942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 729/1464] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:30 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:31.422750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:31.423367 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:31.430471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:31.430953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:31.431389 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:31.432080 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:31.432535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:31.432962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:31.492354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:31.500009 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-067f0e6f-94a0-487d-ad90-76da28d658be tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081109 Oct 02 01:21:31.500577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 736/1465] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:31 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:31.868246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:31.868759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:31.875089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:31.875568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:31.876007 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:31.876692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:31.877149 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:31.877605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:31.901421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Going to try to terminate instance {{(pid=120424) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 02 01:21:31.976445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0a1afcdb-2e0b-484f-ba76-295dbf8c6165 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 204 len: 0 microversion: 2.1 time: 0.111685 Oct 02 01:21:31.977035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 730/1466] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:21:31 2022] DELETE /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 02 01:21:31.985531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:31.986178 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:31.992509 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:31.992988 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:31.993420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:31.994136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:31.994586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:31.995007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:32.121880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:32.129920 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf34a18c-7628-4a89-9ed8-0d1e9f76ec9d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1599 microversion: 2.1 time: 0.148701 Oct 02 01:21:32.130510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 737/1467] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:32.523329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:32.524035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:32.529945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:32.530464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:32.530910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:32.531607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:32.532066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:32.532495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:32.592665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:32.600828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a5eb68bd-20d8-4d85-b84c-f8e8da41d278 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081767 Oct 02 01:21:32.601388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 731/1468] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:32 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:33.152909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:33.153524 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:33.160019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.160500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.160936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.161633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.162106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.162539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.249167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:33.258451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84e9b376-df03-4a07-aeb8-10246b58c871 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1557 microversion: 2.1 time: 0.109441 Oct 02 01:21:33.259034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 738/1469] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1557 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:33.260798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [req-241d52a8-7608-4323-b7a5-7e4d74ce0534 req-ecdece05-4ae4-48d3-aded-c0d469f66372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf3492e-1bdf-44e5-a0dc-e15824c17792", "name": "network-vif-deleted", "tag": "11ca2fd5-4b7b-457f-ad93-842be00a9d18"}]} {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 02 01:21:33.271585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-241d52a8-7608-4323-b7a5-7e4d74ce0534 req-ecdece05-4ae4-48d3-aded-c0d469f66372 service nova] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.272060 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-241d52a8-7608-4323-b7a5-7e4d74ce0534 req-ecdece05-4ae4-48d3-aded-c0d469f66372 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.272520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [req-241d52a8-7608-4323-b7a5-7e4d74ce0534 req-ecdece05-4ae4-48d3-aded-c0d469f66372 service nova] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.283610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.compute.server_external_events [req-241d52a8-7608-4323-b7a5-7e4d74ce0534 req-ecdece05-4ae4-48d3-aded-c0d469f66372 service nova] Creating event network-vif-deleted:11ca2fd5-4b7b-457f-ad93-842be00a9d18 for instance bcf3492e-1bdf-44e5-a0dc-e15824c17792 on hv-cinder-maste Oct 02 01:21:33.288241 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [req-241d52a8-7608-4323-b7a5-7e4d74ce0534 req-ecdece05-4ae4-48d3-aded-c0d469f66372 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031180 Oct 02 01:21:33.288863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 732/1470] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Oct 2 01:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 02 01:21:33.624245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:33.624856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:33.631754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.632233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.632662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.633356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:33.633807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:33.634252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:33.694626 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:33.702440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-242852cf-8626-49a1-9df1-f7f319b90b09 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082182 Oct 02 01:21:33.703005 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 739/1471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:33 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:34.282808 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:34.284019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:34.290221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:34.290722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:34.291151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:34.291834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:34.292278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:34.292698 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:34.358582 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:34.366990 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-31d4f76b-32e5-48cd-873b-7c04bb666ee8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.088986 Oct 02 01:21:34.367558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 733/1472] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:34.724299 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:34.724907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:34.731314 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:34.731795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:34.732227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:34.732909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:34.733356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:34.733781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:34.793783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:34.801469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0beda01d-c9ed-4613-8122-161773984c95 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081135 Oct 02 01:21:34.802041 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 740/1473] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:34 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:35.388440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:35.388966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:35.395430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:35.395910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:35.396345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:35.397036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:35.397487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:35.397913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:35.457987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:35.465982 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aae23096-491f-4928-8fd2-87fa18a7fcd1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081488 Oct 02 01:21:35.466566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 734/1474] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:35.824394 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:35.825004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:35.831863 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:35.832339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:35.832769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:35.833444 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:35.833889 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:35.834335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:35.896142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:35.904032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a07b2a7-ec49-4cbd-9b04-30de53ab05c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083574 Oct 02 01:21:35.904586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 741/1475] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:35 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:36.489543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:36.490207 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:36.496534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.497007 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.497439 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.498145 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.498590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.499016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.560012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:36.568624 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a2a634ea-b413-404f-a252-f8b5fd467f11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083652 Oct 02 01:21:36.569184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 735/1476] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:36.928075 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:36.928680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:36.934990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.935465 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.935896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.936577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:36.937024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:36.937446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:36.997026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:37.004606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d3d0a73-c3d7-4dfd-ad83-6f7043d0c602 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081005 Oct 02 01:21:37.005165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 742/1477] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:36 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:37.590963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:37.591579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:37.597948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:37.598466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:37.598909 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:37.599597 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:37.600049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:37.600502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:37.660996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:37.663383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:37.671098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ea89e354-e2ec-4940-8dd1-a59bfbfe1622 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083993 Oct 02 01:21:37.671879 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 736/1478] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:38.027230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:38.027839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:38.034996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:38.035475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:38.035910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:38.036607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:38.037037 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:38.037456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:38.096969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:38.104572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6654ea3e-4d5c-4189-84a7-e14d83215dca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081454 Oct 02 01:21:38.105135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 743/1479] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:38 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:38.693435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:38.694047 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:38.701545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:38.702024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:38.702595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:38.703288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:38.703739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:38.704163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:38.763865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:38.771957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d20e82b1-9b29-4c84-8e8c-fcbd98f48d6c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083068 Oct 02 01:21:38.772522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 737/1480] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:39.127349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:39.127953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:39.134411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.134881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.135308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.135990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.136434 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.136854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.197929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:39.200084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:39.206600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-637c497a-d016-4cf9-b67e-fef7e3283170 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083200 Oct 02 01:21:39.207161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 744/1481] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:39 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:39.794361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:39.795013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:39.801404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.801887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.802387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.803087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:39.803545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:39.803974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:39.863610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:39.871712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8bdaf01f-09ad-4f63-bced-e6a064db963e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081312 Oct 02 01:21:39.872279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 738/1482] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:40.229406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:40.229949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:40.236911 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:40.237678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:40.238202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:40.238910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:40.239354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:40.239772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:40.300435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:40.308122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ece2812-66bd-40dc-a4fa-78458894d8d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082856 Oct 02 01:21:40.308701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 745/1483] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:40 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:40.893979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:40.894650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:40.901295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:40.901767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:40.902238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:40.902929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:40.903375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:40.903793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:40.963318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:40.972089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c823c564-305d-48a1-ac53-f56d01b34a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082110 Oct 02 01:21:40.972646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 739/1484] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:41.331794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:41.332436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:41.338859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:41.339343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:41.339779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:41.340556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:41.341055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:41.341496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:41.404584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:41.412348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd1bab01-99eb-430a-bc05-6939f11ceefe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085078 Oct 02 01:21:41.412913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 746/1485] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:41 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:41.994476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:41.995105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:42.001498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.002605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.003045 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.003737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.004189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.004612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.063359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:42.072115 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-714efbc2-c18e-47f3-a34f-22cc6b4d110c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081515 Oct 02 01:21:42.072681 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 740/1486] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:42.434929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:42.435541 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:42.441506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.442089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.442607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.443301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:42.443756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:42.444184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:42.503092 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:42.510677 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-52cb89ad-7433-4f05-a85b-18e4707ad558 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.079728 Oct 02 01:21:42.511246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 747/1487] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:42 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:43.094958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:43.095557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:43.097601 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:43.102906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:43.103387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:43.103825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:43.104522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:43.104977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:43.105406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:43.167165 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:43.175788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d7b72f97-03d9-4b28-9154-7d61b5b01f92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084774 Oct 02 01:21:43.176355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 741/1488] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:21:43.532919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:43.533533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:43.540071 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:43.540553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:43.541015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:43.541713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:43.542197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:43.542628 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:43.604991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:43.613614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-239d2c1f-bce1-4cf7-8ade-521a43eba29d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084621 Oct 02 01:21:43.614202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 748/1489] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:43 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:44.198950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:44.199574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:44.206501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:44.206983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:44.207424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:44.208122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:44.208581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:44.209009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:44.270481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:44.279066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7ae724aa-ee0e-46c2-a147-c512ca53e50e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083956 Oct 02 01:21:44.279642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 742/1490] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:44.636106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:44.636668 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:44.638918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=42 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:44.644572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:44.645060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:44.645501 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:44.646236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:44.646693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:44.647120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:44.707660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:44.715355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd32c837-2a08-4d4a-a1b2-a7ca53c91ee1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083169 Oct 02 01:21:44.715910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 749/1491] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:44 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:45.304018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:45.304562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:45.310949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:45.311423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:45.311858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:45.312540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:45.312983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:45.313400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:45.375183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:45.383296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-11307716-7459-4742-8718-7493c6f31e2b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083229 Oct 02 01:21:45.383857 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 743/1492] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:45.738204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:45.738684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:45.745119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:45.745592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:45.746024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:45.746727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:45.747180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:45.747596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:45.809280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:45.817356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54f53f48-3d98-4dca-9902-36c4e6f60fae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083414 Oct 02 01:21:45.817908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 750/1493] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:45 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:46.405215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:46.405764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:46.412146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:46.412627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:46.413062 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:46.413753 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:46.414235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:46.414659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:46.473775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:46.481844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-df28c6d6-211a-4e1b-8902-820d0a1e4fd4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080600 Oct 02 01:21:46.482441 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 744/1494] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:46.839484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:46.840094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:46.847078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:46.847556 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:46.847990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:46.848708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:46.849167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:46.849591 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:46.908484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:46.916076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a0b1427-1b7d-41bb-8025-da34abcf28fd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080423 Oct 02 01:21:46.916633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 751/1495] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:46 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:47.505535 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:47.506168 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:47.512520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:47.512994 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:47.513460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:47.514176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:47.514628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:47.515055 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:47.573858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:47.582489 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a4cf100b-e9b6-4be6-a247-6e1ad47cf2ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081239 Oct 02 01:21:47.583052 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 745/1496] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:47.940625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:47.941244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:47.947802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:47.948283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:47.948715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:47.949403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:47.949886 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:47.950349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:48.261443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:48.269219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47af9893-9843-4856-b096-83fb80decc94 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.333087 Oct 02 01:21:48.269777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 752/1497] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:47 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:48.604773 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:48.605352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:48.612712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:48.613192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:48.613629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:48.614353 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:48.614803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:48.615228 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:48.674036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:48.682154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bd228d13-4a1a-40f6-92ca-bee627256796 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081218 Oct 02 01:21:48.682713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 746/1498] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:49.292346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:49.292907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:49.299403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:49.299879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:49.300313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:49.301003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:49.301458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:49.301882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:49.361015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:49.368893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-525ff8f8-3af3-4a44-8c6d-2d0f83c47efe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080463 Oct 02 01:21:49.369455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 753/1499] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:49 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:49.704612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:49.705838 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:49.712271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:49.712754 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:49.713198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:49.713891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:49.714375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:49.714806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:49.773933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:49.782155 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1acc9eb0-cdb1-49d4-b8e1-de4dd835888f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081442 Oct 02 01:21:49.782721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 747/1500] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:50.390990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:50.391521 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:50.397932 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:50.398469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:50.398903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:50.399594 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:50.400043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:50.400470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:50.461871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:50.469550 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e4a74bb-41a2-4621-b2b5-4cdb7f8cdaaf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082549 Oct 02 01:21:50.470137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 754/1501] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:50 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:50.804638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:50.805255 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:50.811697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:50.812174 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:50.812608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:50.813297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:50.813745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:50.814246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:50.873232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:50.881281 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-810afc48-6fd7-4363-aa0a-04176665e0ec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080509 Oct 02 01:21:50.881843 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 748/1502] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:51.493139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:51.493749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:51.500151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.500632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.501069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.502403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.502858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.503283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.561874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:51.571185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad65c44e-0969-45e4-8d57-09bfdf9a3b26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081860 Oct 02 01:21:51.571766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 755/1503] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:51 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:51.904173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:51.904786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:51.911857 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.912336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.912773 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.913466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:51.913919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:51.914370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:51.973705 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:51.981821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d63b80d8-f0c4-4ea4-a020-da2bc4cf91ed tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081520 Oct 02 01:21:51.982413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 749/1504] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:52.593506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:52.594132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:52.600638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:52.601110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:52.601545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:52.602253 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:52.602703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:52.603121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:52.665784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:52.673346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9ba9458-d13a-45b1-9c41-aab2186381d8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083657 Oct 02 01:21:52.673904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 756/1505] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:52 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:53.005379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:53.005996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:53.012444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.012924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.013364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.014074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.014531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.014965 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.074307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:53.082517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3c76e3cf-d7e8-4618-9329-254700cf1656 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081580 Oct 02 01:21:53.083087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 750/1506] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:53.695673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:53.696229 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:53.702754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.703238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.703673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.704372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:53.705325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:53.705752 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:53.765013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:53.773317 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5dde7df3-bf8d-4ab2-a4d4-3058fa499baa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081590 Oct 02 01:21:53.773890 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 757/1507] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:53 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:54.104804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:54.105417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:54.112163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.112641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.113072 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:54.113764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.114246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.114670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:54.175558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:54.183628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2cab6502-18c9-44ea-8711-7ea22f162b46 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082699 Oct 02 01:21:54.184183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 751/1508] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:54.796694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:54.797303 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:54.803702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.804185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.804626 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:54.805317 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:54.805799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:54.806255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:54.870507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:54.878594 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48b338e6-5c8f-4fac-8c24-980f39a63619 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085842 Oct 02 01:21:54.879152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 758/1509] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:54 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:55.206993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:55.207557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:55.213828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:55.214334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:55.214765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:55.215446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:55.215888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:55.216303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:55.276096 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:55.284325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cde40cdd-d00a-45de-9529-a16580c41e15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081299 Oct 02 01:21:55.284886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 752/1510] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:55.901788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:55.902404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:55.909243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:55.909745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:55.910205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:55.910884 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:55.911331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:55.911757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:55.971126 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:55.978704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d92a8203-7e38-4376-9034-2f1630e784e3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080799 Oct 02 01:21:55.979256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 759/1511] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:55 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:56.307154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:56.307773 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:56.314779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:56.315261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:56.315696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:56.316392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:56.316848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:56.317275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:56.332816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:56.378013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:56.386103 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eecb955e-6e79-4275-b20b-fd86c261682e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082804 Oct 02 01:21:56.386684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 753/1512] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:57.002239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:57.002862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:57.009233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.009711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.010170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.010853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.011302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.011725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.075169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:57.082801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c134a36-6253-4616-bc0d-1f7b0ba90a2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085113 Oct 02 01:21:57.083355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 760/1513] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:56 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:57.410322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:57.410865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:57.417258 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.417738 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.418213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.418907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:57.419358 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:57.419785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:57.479474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:57.487785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-13473d0e-a449-401e-a1d3-c3624ecddb8d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081976 Oct 02 01:21:57.488349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 754/1514] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:58.106090 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:58.106758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:58.113418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.113897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.114371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.115064 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.115513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.115937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.131666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:21:58.177829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:58.186258 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3177a2ff-8d1d-4910-a971-eb048c956213 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083978 Oct 02 01:21:58.186832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 761/1515] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:58 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:58.510202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:58.510818 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:58.517226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.517700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.518165 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.518853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:58.519305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:58.519724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:58.579015 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:58.587166 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e833af2c-652c-4375-b155-ec9f42c5b619 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080844 Oct 02 01:21:58.587743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 755/1516] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:59.210571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:59.211173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:59.217537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:59.218009 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:59.218476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:59.219154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:59.219601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:59.220645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:59.282196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:59.290539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5bbbeb42-60b1-4959-9123-ae96729db3f6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083682 Oct 02 01:21:59.291034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 762/1517] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:59 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:21:59.609486 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:21:59.610133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:21:59.616874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:59.617356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:59.617796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:59.618521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:21:59.618975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:21:59.619402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:21:59.680820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:21:59.689719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-51d3edad-024f-4bbb-834e-d9af63f5fcec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083447 Oct 02 01:21:59.690322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 756/1518] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:21:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:00.313321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:00.313853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:00.320391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.320874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.321349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:00.322042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.322525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.322953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:00.382578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:00.390187 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bd0a371-f5c6-4b7a-b1fa-64b4c7ba2b67 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080839 Oct 02 01:22:00.390751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 763/1519] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:00 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:00.712945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:00.713496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:00.720594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.721072 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.721507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:00.722229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:00.722684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:00.723107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:00.783023 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:00.791199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e346018d-8551-46c5-ac0c-2e2e779413dc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082157 Oct 02 01:22:00.791760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 757/1520] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:01.412621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:01.413169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:01.419616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:01.420094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:01.420525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:01.421206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:01.421653 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:01.422088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:01.483523 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:01.491818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b6118e0e-90ec-40b4-972b-303967187839 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083090 Oct 02 01:22:01.492373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 764/1521] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:01 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:01.856861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:01.857585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:01.864660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:01.865144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:01.865585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:01.866348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:01.866804 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:01.867226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:01.928454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:01.936588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-502c758c-cd6e-4062-9bf1-a41f62f6092e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.126489 Oct 02 01:22:01.937158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 758/1522] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:02.515688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:02.516322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:02.523307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.523780 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.524211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.524896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.525344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.525762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.586559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:02.594043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31387ab4-8345-4a66-a03d-81c75f1d0054 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082239 Oct 02 01:22:02.594618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 765/1523] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:02 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:02.958606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:02.959148 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:02.965485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.965980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.966476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:02.967163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:02.967608 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:02.968029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.027519 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:03.035863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-05a89868-8a40-4c6b-b2bf-41b0317bac4c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081160 Oct 02 01:22:03.036424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 759/1524] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:03.617157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:03.617771 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:03.624244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:03.624716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:03.625143 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.625825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:03.626371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:03.626792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:03.688778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:03.696288 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-267f2909-ee66-4675-9c42-1b0bcfb73166 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083011 Oct 02 01:22:03.696845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 766/1525] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:03 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:04.059050 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:04.059659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:04.066513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:04.066987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:04.067419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:04.068104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:04.068554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:04.068975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:04.129311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:04.137415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7107d0e8-98a4-4cca-b10b-b5a8ac481c9f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082302 Oct 02 01:22:04.137987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 760/1526] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:04.719203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:04.720334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:04.726751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:04.727224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:04.727650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:04.728336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:04.728783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:04.729201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:04.789142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:04.796767 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d17dd3a-9d92-41eb-ac1a-491228a5d964 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081433 Oct 02 01:22:04.797327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 767/1527] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:04 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:05.160648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.161270 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.167859 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.168340 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.168775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.169470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.169953 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.170404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.235499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:05.243931 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fb7435d2-1586-433a-bc64-c5a8f1dc1e34 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.087756 Oct 02 01:22:05.244499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 761/1528] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:05.819989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:05.820630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:05.826995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.827468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.827913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.828586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:05.829035 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:05.829455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:05.891897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:05.900088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1df8b623-6e04-4044-8068-8c2c99fc16cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083860 Oct 02 01:22:05.900879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 768/1529] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:05 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:06.266450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.267071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.273482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.273961 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.274435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.275132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.275584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.276006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.336075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:06.344517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0d24289e-b222-4c16-b660-8538b0677acd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081895 Oct 02 01:22:06.345586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 762/1530] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:06.922860 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:06.923495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:06.929829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.930335 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.930766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.931452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:06.931906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:06.932328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:06.994032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:07.002151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f21a0efd-1039-4f94-9b04-1ae677418726 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083163 Oct 02 01:22:07.002711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 769/1531] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:06 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:07.368042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:07.368634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:07.375107 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:07.375593 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:07.376701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:07.377427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:07.377884 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:07.378347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:07.437882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:07.446884 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-279ff4a0-1769-4686-835f-54385a9982c0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082751 Oct 02 01:22:07.447451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 763/1532] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:08.025196 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:08.025868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:08.032364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:08.032845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:08.033277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:08.034569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:08.035020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:08.035443 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:08.097697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:08.105407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fab3090a-173d-46b8-b6a1-1f9905ce8673 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084067 Oct 02 01:22:08.105957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 770/1533] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:08 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:08.469498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:08.470044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:08.476932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:08.477406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:08.477834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:08.478549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:08.479024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:08.479443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:08.538420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:08.546388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a0c75b4c-da37-47c3-a7e4-807573afdbc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080823 Oct 02 01:22:08.546949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 764/1534] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:08 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:09.127874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:09.128519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:09.135072 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:09.135557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:09.135999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:09.136693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:09.137149 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:09.137577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:09.202266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:09.211271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1aadd1c8-467f-49fb-97c5-2459775c9046 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.087804 Oct 02 01:22:09.211842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 771/1535] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:09 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:09.570939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:09.571550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:09.577814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:09.578321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:09.578756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:09.579440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:09.579888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:09.580338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:09.639687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:09.647866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e6564e16-a52e-4d70-a446-88cacc890ca9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080922 Oct 02 01:22:09.648431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 765/1536] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:22:10.233862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:10.234525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:10.241164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.241646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.242106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.242801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.243259 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.243685 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.305476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:10.313161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90fc7f15-b4bd-4076-9afb-4ccd3ebeeef1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083167 Oct 02 01:22:10.313721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 772/1537] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:10 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:10.670256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:10.670905 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:10.677839 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.678348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.678789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.679478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:10.679930 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:10.680351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:10.739698 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:10.747733 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6e5ffe78-9c72-4ef2-8102-1181abad3930 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081503 Oct 02 01:22:10.748297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 766/1538] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:11.336391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:11.336925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:11.343400 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.343882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.344316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.345006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.345459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.345945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.405751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:11.413372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c350e9f3-7e75-4692-9b62-7187e7dde1ab tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080955 Oct 02 01:22:11.413936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 773/1539] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:11 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:11.770919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:11.771534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:11.777937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.778452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.778890 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.779582 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:11.780036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:11.780459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:11.842507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:11.850924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1beeaefb-b01e-4ba0-b640-dda35b184ebe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083807 Oct 02 01:22:11.851521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 767/1540] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:12.435645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.436188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:12.442310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.442788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.443227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.443909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.444358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.444921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.506547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:12.514048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c74eb3d1-5732-4fca-93b5-d7aace678bc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082319 Oct 02 01:22:12.514632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 774/1541] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:12.874365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:12.875004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:12.881627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.882128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.882559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.883236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:12.883681 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:12.884101 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:12.942683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:12.950724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cbd26516-7034-41e5-b8ba-1d67391e3fd3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080262 Oct 02 01:22:12.951283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 768/1542] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:13.537182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:13.537830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:13.544294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.544777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.545218 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.545912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.546396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.546820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.605954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:13.614214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-edebfff9-9acc-40b5-9fb5-7440eeca6daf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081391 Oct 02 01:22:13.614774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 775/1543] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:13 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:13.973761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:13.974440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:13.976807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=56 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:13.982244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.982724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.983161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:13.983851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:13.984303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:13.984725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.044685 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:14.052969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cc212585-8cbc-4da7-a4ad-0ba664d5e881 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083689 Oct 02 01:22:14.053531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 769/1544] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:14.636101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:14.636652 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:14.643879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.644387 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.644803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.645498 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:14.645951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:14.646407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:14.709167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:14.716821 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf9d674a-ed11-4ef8-a87f-2aaf5ba9f927 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084671 Oct 02 01:22:14.717389 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 776/1545] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:14 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:15.075552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:15.076169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:15.082864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:15.083354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:15.083793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:15.084526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:15.084985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:15.085413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:15.089469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:15.145870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:15.154127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c66f1680-a234-49e0-9ff2-5b2748319fda tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082410 Oct 02 01:22:15.154699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 770/1546] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:15.740210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:15.740831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:15.743211 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=56 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:15.748386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:15.748871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:15.749310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:15.750007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:15.750491 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:15.750923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:15.812051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:15.820216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15ef4183-cd37-44d4-acec-49aff52e01c8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084127 Oct 02 01:22:15.820780 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 777/1547] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:15 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:16.177571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:16.178218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:16.184668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.185149 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.185585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:16.186309 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.186765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.187192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:16.246404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:16.255103 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2517a7e3-b305-4679-b554-743b5deb0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081840 Oct 02 01:22:16.255664 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 771/1548] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:16.843476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:16.844093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:16.850623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.851107 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.851543 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:16.852234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:16.852690 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:16.853119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:16.857111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:16.919174 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:16.927530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-befc1e69-377b-4551-ac36-c000e50e8ff6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.087878 Oct 02 01:22:16.928111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 778/1549] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:16 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:17.277976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:17.278651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:17.285474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:17.285971 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:17.286427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:17.287111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:17.287565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:17.287983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:17.347660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:17.355794 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6ce083ad-5b4b-4f5a-902e-6a2209aaf093 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081630 Oct 02 01:22:17.356361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 772/1550] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:17.951014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:17.951630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:17.958600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:17.959104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:17.959527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:17.960253 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:17.960710 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:17.961139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:18.020331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:18.028118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94b7cfa4-55be-40f2-9dec-ae4249b34f75 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081040 Oct 02 01:22:18.028831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 779/1551] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:17 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:18.379335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:18.379954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:18.386501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:18.386986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:18.387423 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:18.388118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:18.388575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:18.389003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:18.448934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:18.457029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b968cd35-369c-4512-ae94-6ae31e9298c4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082142 Oct 02 01:22:18.457634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 773/1552] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:19.052192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:19.052809 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:19.059294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.059775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.060216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.060944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.061403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.061828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.125864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:19.133676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a9ce19e-909a-4980-901d-4f038caae855 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085990 Oct 02 01:22:19.134273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 780/1553] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:19 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:19.480006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:19.480621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:19.487531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.488003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.488433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.489116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:19.489564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:19.489983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:19.549188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:19.557376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-02f57627-597f-483c-8997-187037057996 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081877 Oct 02 01:22:19.557921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 774/1554] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:20.156636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:20.157242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:20.163635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.164111 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.164536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.165217 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.165665 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.166113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.225122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:20.232584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6813aee6-04b0-40bc-aeec-59b7b5e43f80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.079758 Oct 02 01:22:20.233136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 781/1555] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:20 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:20.580338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:20.580936 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:20.587337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.587812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.588239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.588951 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:20.589399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:20.589848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:20.650053 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:20.658740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-78dfd483-7581-4741-a4ac-0a30f6b3eee5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081550 Oct 02 01:22:20.659301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 775/1556] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:21.256139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:21.256747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:21.263191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:21.263677 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:21.264113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:21.264804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:21.265274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:21.265691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:21.328711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:21.337060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da8c50ed-1572-40e2-8788-0873d235d19a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085275 Oct 02 01:22:21.337617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 782/1557] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:21 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:21.681360 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:21.681912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:21.688330 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:21.688806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:21.689855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:21.690570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:21.691029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:21.691451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:21.750052 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:21.758700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-88b7ccc9-dbc3-42cd-88a4-a64a92689d30 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081295 Oct 02 01:22:21.759259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 776/1558] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:22.359507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:22.360051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:22.366713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.367185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.367610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.368291 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.368736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.369155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.428730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:22.436441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b81f2544-2e36-4af2-ae32-85e91012b769 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080888 Oct 02 01:22:22.437003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 783/1559] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:22 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:22.780536 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:22.781154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:22.787594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.788079 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.788514 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.789208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:22.789659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:22.790108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:22.849939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:22.858026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a2c46866-a191-455a-879f-7b48d98ca864 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081390 Oct 02 01:22:22.858612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 777/1560] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:23.459582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:23.460184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:23.466559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:23.467036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:23.467460 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:23.468142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:23.468587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:23.469006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:23.531520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:23.539118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-06cd3cbb-8f22-43ff-9db3-d283a8500083 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083458 Oct 02 01:22:23.539671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 784/1561] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:23 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:23.881852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:23.882534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:23.889181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:23.889669 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:23.890161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:23.890860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:23.891313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:23.891764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:23.953020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:23.961368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-15c6ced8-c519-4fb7-b2e0-98c37ce956fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083433 Oct 02 01:22:23.961938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 778/1562] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:24.561779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:24.562421 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:24.568849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.569288 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.569696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.570444 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.570891 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.571308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.632855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:24.640578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b7702eb-70ca-4f82-a0e6-d56d09d03862 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082696 Oct 02 01:22:24.641135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 785/1563] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:24 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:24.983888 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:24.984426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:24.991053 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.991533 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.991970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:24.992695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:24.993146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:24.993571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:25.053634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:25.061813 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e6fa15ee-fb99-4e84-929d-d051aba6c3e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081976 Oct 02 01:22:25.062419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 779/1564] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:25.664158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:25.664721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:25.671105 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:25.671575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:25.672000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:25.672683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:25.673128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:25.673548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:25.735351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:25.743771 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-acefe3d1-4e2c-4363-baa4-eab3aa8379f8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083609 Oct 02 01:22:25.744322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 786/1565] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:25 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:26.085487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:26.086169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:26.092560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:26.093040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:26.093477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:26.094205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:26.094660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:26.095088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:26.154636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:26.163467 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a0b433f5-fa0d-47b3-aaf4-37af17272605 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081953 Oct 02 01:22:26.164042 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 780/1566] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:26.766000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:26.766624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:26.773018 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:26.773493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:26.773923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:26.774646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:26.775099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:26.775521 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:26.835293 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:26.842956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f1e666a-c2e8-49c3-8779-7a611ce286d4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080879 Oct 02 01:22:26.843522 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 787/1567] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:26 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:27.186173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:27.186796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:27.193196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:27.193677 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:27.194138 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:27.194835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:27.195295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:27.195726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:27.258792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:27.267020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0c79d286-98fd-47a2-8146-b182f6f8b2a2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084740 Oct 02 01:22:27.267587 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 781/1568] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:27.865442 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:27.866089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:27.872481 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:27.872958 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:27.873392 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:27.874099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:27.874557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:27.874979 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:27.937007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:27.945118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a96e90c-e356-4ec5-8d91-af5ea7aaa0c0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083775 Oct 02 01:22:27.945671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 788/1569] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:27 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:28.289507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:28.290147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:28.296460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:28.296934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:28.297364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:28.298046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:28.298518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:28.299020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:28.358448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:28.368028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9800eeae-1d75-4a5b-be4c-4a1094519b7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082798 Oct 02 01:22:28.368589 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 782/1570] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:28.968104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:28.968713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:28.975741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:28.976217 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:28.976651 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:28.977332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:28.977781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:28.978234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:29.037893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:29.045743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-198e619b-a12c-4104-9f3f-bcf445546605 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081482 Oct 02 01:22:29.046330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 789/1571] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:28 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:29.391181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:29.391789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:29.398853 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:29.399329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:29.399758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:29.400446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:29.400891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:29.401311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:29.460662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:29.468742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0acb6e06-efb0-494c-b9e0-587b7bfd3d3c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081439 Oct 02 01:22:29.469301 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 783/1572] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:30.068360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:30.068962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:30.075397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:30.075873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:30.076300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:30.076990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:30.077435 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:30.077857 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:30.140428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:30.148003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9d11941-db16-4c63-8c0e-54f66b6ba3f9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083543 Oct 02 01:22:30.148555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 790/1573] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:30 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:30.491582 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:30.492230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:30.498600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:30.499074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:30.499501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:30.500178 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:30.500623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:30.501039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:30.560256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:30.568318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7401038e-cc3e-46a7-b31f-e1dd5671ad53 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080607 Oct 02 01:22:30.568883 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 784/1574] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:31.171021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:31.171635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:31.178599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:31.179079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:31.179540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:31.180226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:31.180680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:31.181105 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:31.243636 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:31.252035 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ee329c1-a8aa-41bb-ad4b-5a08c370d766 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084881 Oct 02 01:22:31.253169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 791/1575] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:31 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:31.591159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:31.591768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:31.598699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:31.599169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:31.599595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:31.600275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:31.600723 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:31.601141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:31.660607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:31.668605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-58c34e1b-49e1-4e03-8e3d-f22922dd6e29 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081267 Oct 02 01:22:31.669163 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 785/1576] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:32.274983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:32.275601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:32.282081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:32.282568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:32.283010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:32.283700 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:32.284158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:32.284582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:32.347009 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:32.354840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b07d766-b0f7-42aa-ba73-bb6717dd890f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083823 Oct 02 01:22:32.355455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 792/1577] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:32 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:32.692029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:32.692562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:32.698940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:32.699415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:32.699847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:32.700527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:32.700975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:32.701396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:32.760573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:32.762699 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:32.769847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-87f785b1-b296-43de-8b3e-d5be971a63b8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082311 Oct 02 01:22:32.770444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 786/1578] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:33.377904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:33.378453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:33.384880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:33.385351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:33.385779 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:33.386495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:33.386943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:33.387382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:33.447206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:33.455624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c5d66e45-51ad-4ada-a7b4-151e86abff8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081178 Oct 02 01:22:33.456208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 793/1579] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:33 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:33.792331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:33.792989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:33.799233 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:33.799707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:33.800141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:33.800824 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:33.801276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:33.801695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:33.860847 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:33.869152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b4d0d9d5-5434-45b4-81f2-270269afa5a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080781 Oct 02 01:22:33.869708 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 787/1580] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:34.478222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:34.478844 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:34.485317 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:34.485798 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:34.486272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:34.487481 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:34.487940 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:34.488368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:34.552946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:34.555182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:34.561861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27ca3ee0-a4dc-41e8-a33f-1ed7daacdb5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.087543 Oct 02 01:22:34.562467 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 794/1581] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:34 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:34.892320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:34.893377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:34.899874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:34.900350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:34.900783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:34.901465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:34.901911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:34.902358 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:34.961878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:34.969997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5d224fd7-0a99-4468-beed-3a894234dc1d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081562 Oct 02 01:22:34.970587 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 788/1582] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:35.584842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:35.585389 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:35.591985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:35.592468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:35.592902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:35.593594 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:35.594050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:35.594507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:35.653525 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:35.661192 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9aa4b539-30ed-43a8-94df-b9def32a9254 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080915 Oct 02 01:22:35.661750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 795/1583] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:35 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:35.993230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:35.993916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:36.000349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:36.000829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:36.001263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:36.002594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:36.003054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:36.003480 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:36.064216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:36.072356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5c43eede-a1d6-4b4e-8fcc-4c2bfc0f89c7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082993 Oct 02 01:22:36.072936 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 789/1584] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:36.684093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:36.684699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:36.691079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:36.691559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:36.691991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:36.692673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:36.693120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:36.693539 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:36.756024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:36.763617 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-576c4fa0-574d-459a-8733-53e97f27126a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083342 Oct 02 01:22:36.764179 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 796/1585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:36 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:37.094791 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:37.095427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:37.101958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:37.102474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:37.102905 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:37.103592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:37.104037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:37.104458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:37.165623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:37.173695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-37e12aeb-6da6-4906-b4a7-69e03ae48e27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082769 Oct 02 01:22:37.174775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 790/1586] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:37.786973 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:37.787579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:37.793996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:37.794504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:37.794935 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:37.795702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:37.796152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:37.797142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:37.860122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:37.868806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab1e9c19-8ccc-457c-a6da-47372a366825 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.086187 Oct 02 01:22:37.869371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 797/1587] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:37 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:38.196801 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:38.197403 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:38.203715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:38.204195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:38.204622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:38.205816 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:38.206291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:38.206715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:38.266949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:38.276001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-550182e2-64db-4c36-b655-3790af652cf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083039 Oct 02 01:22:38.276579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 791/1588] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:38.891418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:38.892069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:38.898501 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:38.898980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:38.899415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:38.900106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:38.900559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:38.900983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:38.965065 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:38.972848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-99d53986-a736-461c-a877-1f09a71f1b04 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085358 Oct 02 01:22:38.973415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 798/1589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:38 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:39.298471 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:39.299705 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:39.306134 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:39.306625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:39.307069 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:39.307788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:39.308247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:39.308675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:39.369126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:39.377199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-223195b8-4f96-4af0-8faf-e239ae076149 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082576 Oct 02 01:22:39.377764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 792/1590] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:39.995739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:39.996369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:40.003270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:40.003740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:40.004172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:40.004856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:40.005302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:40.005717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:40.065388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:40.073030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9bdbdca7-d881-4943-aee4-75e2b8c39374 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081150 Oct 02 01:22:40.073590 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 799/1591] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:39 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:40.399594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:40.400139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:40.406639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:40.407100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:40.407502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:40.408196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:40.408650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:40.409076 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:40.469408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:40.477615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a14f77e6-dee3-4f49-bcad-9a9ccc370c50 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081954 Oct 02 01:22:40.478202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 793/1592] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:41.095237 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:41.096430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:41.102818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:41.103296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:41.103726 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:41.104407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:41.104854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:41.105272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:41.175071 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:41.183097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2d58a41b-4873-4db7-a320-f56e1039dc26 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.091637 Oct 02 01:22:41.183675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 800/1593] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:41 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:41.499429 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:41.500041 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:41.506978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:41.507454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:41.507885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:41.508567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:41.509013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:41.509432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:41.568667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:41.576779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-57c67496-e3db-4aef-b8c0-c77a93f6366e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081170 Oct 02 01:22:41.577349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 794/1594] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:42.205967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:42.206601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:42.212616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:42.213093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:42.213535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:42.214250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:42.214702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:42.215122 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:42.274150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:42.281843 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d838a89b-5b75-440b-9778-87a227787204 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.079855 Oct 02 01:22:42.282432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 801/1595] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:42 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:42.600320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:42.600942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:42.607298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:42.607777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:42.608210 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:42.608900 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:42.609356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:42.609779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:42.668970 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:42.677026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a4d476e3-00be-4d6e-936f-bc4c855cf435 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081233 Oct 02 01:22:42.677589 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 795/1596] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:43.305538 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:43.306098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:43.312691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:43.313169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:43.313603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:43.314990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:43.315448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:43.315874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:43.378560 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:43.386201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a5cafd8-18b4-4402-89e3-ac6993346746 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084799 Oct 02 01:22:43.386754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 802/1597] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:43 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:43.699240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:43.699785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:43.706243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:43.706727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:43.707161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:43.707871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:43.708307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:43.708734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:43.768149 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:43.776399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3a27c01e-3897-417f-a014-ea9551788515 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081082 Oct 02 01:22:43.777022 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 796/1598] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:44.408639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:44.409245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:44.415664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:44.416175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:44.416603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:44.417286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:44.417732 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:44.418178 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:44.477764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:44.485436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3acf516d-f722-4af6-8e6e-62626c1d246d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080628 Oct 02 01:22:44.485994 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 803/1599] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:44 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:44.800249 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:44.800892 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:44.803216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=56 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:44.808382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:44.808865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:44.809303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:44.809996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:44.810475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:44.810903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:44.870424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:44.879132 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-18596864-3e5a-4374-9560-674da73c37fb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083264 Oct 02 01:22:44.879754 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 797/1600] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:45.507827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:45.508479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:45.514817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:45.515292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:45.515721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:45.516403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:45.516849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:45.517776 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:45.583188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:45.591173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1dbab5c3-6c5a-48f2-b932-5105ba36904b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.087259 Oct 02 01:22:45.591726 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 804/1601] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:45 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:45.902088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:45.902707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:45.910654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:45.911130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:45.911557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:45.912239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:45.912683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:45.913098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:45.973749 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:45.981933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-899bd725-a900-4c4b-bea7-209b1d5611b3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083825 Oct 02 01:22:45.982524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 798/1602] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:46.615637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:46.616280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:46.618624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=56 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:46.623896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:46.624373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:46.624806 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:46.625500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:46.625951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:46.626401 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:46.687558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:46.695158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a7f6ccb-86c7-4220-8002-fd505d1c5492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084195 Oct 02 01:22:46.695727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 805/1603] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:46 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:47.004653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:47.005265 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:47.011637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:47.012117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:47.012548 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:47.013235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:47.013681 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:47.014127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:47.073560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:47.082364 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5fed6852-5c2d-41ec-af1e-a19956ab932a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081532 Oct 02 01:22:47.082959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 799/1604] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:47.716758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:47.717305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:47.723789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:47.724258 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:47.724687 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:47.725372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:47.725820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:47.726269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:47.788573 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:47.796378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82304835-4083-4091-be49-1e74d951f791 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083537 Oct 02 01:22:47.796939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 806/1605] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:47 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:48.104776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:48.105383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:48.112682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:48.113164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:48.113597 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:48.114310 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:48.114764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:48.115189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:48.175497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:48.183746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-07e230f0-eaa9-442e-975b-5dbcac280e1a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082895 Oct 02 01:22:48.184525 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 800/1606] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:48.820052 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:48.822901 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:48.827252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:48.827726 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:48.828160 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:48.828841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:48.829290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:48.830373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:48.889477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:48.897532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ac1c9fd-8165-45c1-9d74-2dd285e41f7f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081303 Oct 02 01:22:48.898110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 807/1607] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:48 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:49.205934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:49.206479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:49.212906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:49.213385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:49.213811 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:49.214522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:49.214969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:49.215388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:49.275046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:49.283110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ebbf01e8-904b-491e-bf54-8147cfbde953 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081112 Oct 02 01:22:49.283663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 801/1608] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:49.920516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:49.921078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:49.927674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:49.928145 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:49.928597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:49.929279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:49.929723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:49.930183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:49.993284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:50.000957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a184724-ac58-4cf0-ba18-26a5b8af4452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084394 Oct 02 01:22:50.001510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 808/1609] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:49 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:50.305732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:50.306373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:50.312930 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:50.313409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:50.314429 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:50.315125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:50.315601 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:50.316030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:50.375139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:50.383721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5be3770e-8791-4225-b4c8-6a2c41fd1a62 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081923 Oct 02 01:22:50.384286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 802/1610] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:51.023370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:51.023980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:51.031151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:51.031640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:51.032069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:51.033265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:51.033710 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:51.034151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:51.093478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:51.101532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-07a59f41-4303-4786-baf7-847202754d80 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082010 Oct 02 01:22:51.102137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 809/1611] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:51 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:51.407192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:51.408335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:51.414739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:51.415215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:51.415649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:51.416338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:51.416788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:51.417216 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:51.431886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:51.478502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:51.486843 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c72159f5-d9e7-43d0-84e6-0e8f8f5dd65f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083355 Oct 02 01:22:51.487400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 803/1612] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:52.124858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:52.125466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:52.132475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:52.132949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:52.133378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:52.134077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:52.134527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:52.134944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:52.196980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:52.204816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b810f7c-d811-48f4-862f-8a5a12639681 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083778 Oct 02 01:22:52.205373 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 810/1613] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:52 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:52.508371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:52.509025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:52.515490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:52.515975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:52.516416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:52.517111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:52.517567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:52.517996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:52.578500 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:52.586711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0fe56f0c-e55a-4185-a419-8f93b7999e26 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082204 Oct 02 01:22:52.587279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 804/1614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:53.227456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:53.228070 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:53.234515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:53.235002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:53.235440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:53.236140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:53.236845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:53.237271 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:53.252393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:22:53.300552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:53.308305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0da946b-9255-43c3-b27a-9ff806abe8d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084758 Oct 02 01:22:53.308878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 811/1615] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:53 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:53.608791 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:53.609369 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:53.616585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:53.617066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:53.617503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:53.618235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:53.618691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:53.619118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:53.678404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:53.686440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ec3b247a-8dff-4ffb-95b2-03fd29001d81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081568 Oct 02 01:22:53.686998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 805/1616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:54.331066 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:54.331677 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:54.338133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:54.338624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:54.339061 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:54.339755 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:54.340239 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:54.340668 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:54.403054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:54.411298 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2bb34a15-dbd3-4807-9a05-02dea481c230 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084082 Oct 02 01:22:54.411864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 812/1617] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:54 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:54.709955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:54.710555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:54.716862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:54.717340 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:54.717775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:54.718492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:54.718943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:54.719375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:54.782145 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:54.790270 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-25752500-f27b-4892-b426-21d2b25bce90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084238 Oct 02 01:22:54.790833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 806/1618] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:55.434040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:55.434632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:55.441742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:55.442266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:55.442708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:55.443402 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:55.443858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:55.444285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:55.504205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:55.511839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d60e4b7-0136-4559-8c2d-6fa0580a771b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081785 Oct 02 01:22:55.512412 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 813/1619] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:55 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:55.813444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:55.814118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:55.820502 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:55.820972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:55.821403 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:55.822105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:55.822557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:55.822978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:55.882036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:55.890111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3d35ad5e-924f-4e4f-a986-60db79e9d7df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080537 Oct 02 01:22:55.890674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 807/1620] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:56.639167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:56.639774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:56.645707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:56.646222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:56.646654 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:56.647336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:56.647786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:56.648206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:56.709822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:56.717473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8683534d-cedc-4edd-9678-75b65f658a38 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.187756 Oct 02 01:22:56.718030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 814/1621] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:56 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:56.912829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:56.913363 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:56.919908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:56.920388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:56.920823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:56.921513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:56.921963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:56.922413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:56.981498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:56.990374 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ab1f1f6e-75fe-4974-bda5-8f2d0209ba10 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081536 Oct 02 01:22:56.990943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 808/1622] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:57.740673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:57.741290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:57.747703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:57.748174 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:57.748603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:57.749283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:57.749734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:57.750186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:57.809262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:57.817704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dae8af16-b453-4b33-a0a0-6b1f191ce23f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081230 Oct 02 01:22:57.818442 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 815/1623] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:57 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:58.013357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:58.013908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:58.020943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:58.021422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:58.021861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:58.022582 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:58.023035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:58.023460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:58.083300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:58.091271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-add9e4d4-009c-4c0c-bdfe-7a181cd20110 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081863 Oct 02 01:22:58.091834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 809/1624] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:58.840735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:58.841345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:58.848215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:58.848691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:58.849121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:58.849801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:58.850284 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:58.850703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:58.913403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:58.921283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b22f301-d35c-47dc-a965-65e9d88791f1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084350 Oct 02 01:22:58.921844 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 816/1625] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:58 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:59.114037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:59.114619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:59.120991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.121472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.121912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:59.122667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.123119 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.123550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:59.183397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:22:59.191620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bf1cb989-dc94-41b4-9695-7197c356efab tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081867 Oct 02 01:22:59.192192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 810/1626] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:22:59.946910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:22:59.947552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:22:59.953904 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.954410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.954840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:22:59.955520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:22:59.955970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:22:59.956386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:00.016166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:00.024016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c719538-df7c-4952-bcf8-afc89acbc1df tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080961 Oct 02 01:23:00.024571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 817/1627] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:22:59 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:00.214445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:00.215011 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:00.221806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:00.222303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:00.222737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:00.223420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:00.223869 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:00.224289 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:00.283016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:00.291531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2ecd91c1-c07c-4a1a-a86e-7afa0649178a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081040 Oct 02 01:23:00.292086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 811/1628] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:01.046655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:01.047268 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:01.049200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:23:01.049345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:23:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd (ip 10.222.0.25) !!! Oct 02 01:23:01.051408 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:23:01.051535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:23:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd (ip 10.222.0.25) !!! Oct 02 01:23:01.052440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:23:01.052931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:23:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd (ip 10.222.0.25) !!! Oct 02 01:23:01.070471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:01.070951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:01.071386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:01.072115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:01.072566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:01.073020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:01.135836 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:01.143754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c6719e8-40ff-4906-9818-c9e38cd011f3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.100921 Oct 02 01:23:01.144318 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 818/1629] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:01 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:01.314484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:01.315611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:01.321945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:01.322455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:01.322886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:01.323569 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:01.324017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:01.324438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:01.384282 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:01.392326 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-499b2496-5a15-4551-a1bc-6306656702d1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081753 Oct 02 01:23:01.392886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 812/1630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:02.166236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:02.166850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:02.173267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:02.173751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:02.174717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:02.175409 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:02.175868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:02.176297 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:02.235449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:02.244194 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2209f80a-8d89-4f41-ab19-43fc9ad06099 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081836 Oct 02 01:23:02.244755 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 819/1631] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:02 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:02.415176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:02.415713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:02.417797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:23:02.417932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 (ip 10.222.0.25) !!! Oct 02 01:23:02.418950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:23:02.419065 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 (ip 10.222.0.25) !!! Oct 02 01:23:02.431176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:02.431670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:02.432112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:02.432820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:02.433279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:02.433712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:02.497333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:02.505447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-574fd2a2-d69f-4d8f-8ecc-9fe28d2dc9f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.094276 Oct 02 01:23:02.506008 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 813/1632] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:03.266766 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:03.267369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:03.273772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:03.274355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:03.274789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:03.275479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:03.275929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:03.276361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:03.340081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:03.348380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b73f08c-32c8-4792-b5ce-e04958463c99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085512 Oct 02 01:23:03.348943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 820/1633] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:03 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:03.527946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:03.528564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:03.535150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:03.535632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:03.536065 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:03.536754 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:03.537203 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:03.537625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:03.597239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:03.605453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2e6cac73-bc71-4369-be0d-f696c08d6cf8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081603 Oct 02 01:23:03.606020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 814/1634] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:04.371475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:04.372025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:04.378604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.379107 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.379527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.380222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.380683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.381115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.440948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:04.448704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-872d3206-d60f-496f-bb46-6b7eb454a17b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081267 Oct 02 01:23:04.449269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 821/1635] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:04 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:04.629116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:04.629674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:04.636131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.636612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.637048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.637737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:04.638226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:04.638655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:04.699989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:04.708632 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8bf0204c-5a3c-4ae9-9dab-442101388552 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083967 Oct 02 01:23:04.709197 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 815/1636] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:05.472121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:05.472736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:05.479179 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.479663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.480102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.480796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.481254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.481681 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.544224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:05.552464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89f5093a-45c5-45a3-80a6-23e827b5c519 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084726 Oct 02 01:23:05.553028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 822/1637] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:05 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:05.739838 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:05.740405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:05.746836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.747316 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.747751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.748524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:05.749019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:05.749499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:05.809959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:05.817976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ef8a4ca5-58bc-4a0e-b138-9e9cc271e8fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082351 Oct 02 01:23:05.818576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 816/1638] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:06.575011 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:06.575553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:06.582010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.582515 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.582945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.583625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.584070 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.584487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.643861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:06.651969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84765361-f36b-49c4-8779-7120c70674c6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080817 Oct 02 01:23:06.652535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 823/1639] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:06 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:06.840722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:06.841295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:06.848147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.848622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.849054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.849740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:06.850218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:06.850638 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:06.909967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:06.918454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0486cb66-0db9-453d-8167-af91165df1c3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081616 Oct 02 01:23:06.919029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 817/1640] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:07.673709 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:07.674368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:07.680785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:07.681267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:07.681705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:07.682423 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:07.682881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:07.683307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:07.747607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:07.755756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90cea90a-d288-4419-b13e-ec4e5e367ac0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085948 Oct 02 01:23:07.756320 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 824/1641] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:07 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:07.941933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:07.942616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:07.949657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:07.950176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:07.950615 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:07.951345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:07.951800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:07.952228 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:08.256760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:08.265102 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e86f45a6-7e00-4b12-8951-24b49e178a38 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.327681 Oct 02 01:23:08.265688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 818/1642] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:08.778511 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:08.779126 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:08.786327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:08.786817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:08.787256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:08.787953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:08.788410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:08.788841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:08.849250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:08.856850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36b38757-4c4d-4ad6-b294-81c2459168fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082189 Oct 02 01:23:08.857410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 825/1643] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:08 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:09.287745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:09.288322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:09.295099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:09.295585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:09.296026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:09.296724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:09.297180 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:09.297607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:09.359747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:09.369192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-66eadae2-538c-4d00-83c2-2f7dfff209d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085082 Oct 02 01:23:09.370223 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 819/1644] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:09.878978 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:09.879957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:09.886317 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:09.886805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:09.887242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:09.887948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:09.888406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:09.888836 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:09.948489 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:09.956248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74f0a690-98c6-4b1f-9e1a-7ef2564eb3c7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081350 Oct 02 01:23:09.956816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 826/1645] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:09 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:10.393371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:10.394032 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:10.400492 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:10.400976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:10.401416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:10.402135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:10.402592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:10.403019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:10.405546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:10.464772 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:10.473556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3e523f93-72cb-4049-ab17-c5fd27528491 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084596 Oct 02 01:23:10.474155 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 820/1646] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:10.979306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:10.979912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:10.987337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:10.987810 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:10.988240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:10.988924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:10.989369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:10.989789 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:11.055119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:11.062817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-01e58bbc-c66e-4210-a454-df7c55b508d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.087348 Oct 02 01:23:11.063375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 827/1647] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:10 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:11.496125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:11.496748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:11.503236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:11.503724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:11.504168 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:11.504871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:11.505325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:11.505753 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:11.564978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:11.573098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4baa01e0-776d-462d-a95f-791d8629078d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080855 Oct 02 01:23:11.573667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 821/1648] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:12.086729 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:12.087345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:12.093436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.093914 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.094376 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.095064 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.095603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.096027 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.099909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:12.155921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:12.163584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-07d785d2-77fe-4c14-8e51-844d3f4f71bc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080728 Oct 02 01:23:12.164156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 828/1649] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:12 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:12.595879 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:12.596489 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:12.602544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.603022 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.603452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.604139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:12.604584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:12.605003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:12.666230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:12.674726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a6023604-edc8-4390-88c5-0042e63512fc tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082714 Oct 02 01:23:12.675290 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 822/1650] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:13.186001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:13.186635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:13.193074 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.193551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.193989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.194701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.195154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.195578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.255632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:13.263300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c55f981f-12e8-48d6-9bd5-8399a76d106f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081153 Oct 02 01:23:13.263868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 829/1651] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:13 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:13.696726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:13.697319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:13.703766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.704245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.704684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.705991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:13.706482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:13.706911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:13.765384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:13.774213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7dcbc1fc-e14b-450b-af61-b593c62b6cce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081386 Oct 02 01:23:13.774780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 823/1652] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:14.286750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:14.287301 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:14.293676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:14.294219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:14.294659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:14.295348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:14.295799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:14.296223 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:14.356642 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:14.365369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-91234391-eb0f-408e-92f7-3f706cade94d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083061 Oct 02 01:23:14.365934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 830/1653] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:14 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:14.796808 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:14.798121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:14.804694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:14.805204 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:14.805641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:14.806372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:14.806826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:14.807256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:14.872097 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:14.880344 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fe8be6a4-a450-4b61-aa24-29c56d4bb6e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.087453 Oct 02 01:23:14.880909 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 824/1654] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:15.390928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:15.391547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:15.398127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:15.398609 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:15.399040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:15.399736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:15.400189 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:15.400612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:15.461592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:15.469199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1866073-06a6-4071-93bf-8a0b63d85266 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084694 Oct 02 01:23:15.469764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 831/1655] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:15 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:15.903540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:15.904153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:15.906499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=56 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:15.912458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:15.912946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:15.913379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:15.914091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:15.914556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:15.914989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:15.976153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:15.984558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5f7a9fa2-9d65-4db2-a4a4-42213f297eec tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084919 Oct 02 01:23:15.985127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 825/1656] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:16.492521 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:16.493135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:16.499608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.500089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.500526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.501216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:16.501669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:16.502121 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:16.563044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:16.570763 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5310f45-a8c0-405f-a9a8-d72914c0dcc3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082109 Oct 02 01:23:16.571327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 832/1657] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:16 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:17.008116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:17.008729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:17.015183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.015663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.016096 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.016780 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.017724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.018210 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.089670 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:17.098771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eaeee193-f790-4ab5-8b06-c8fc10bf4e11 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.094520 Oct 02 01:23:17.099331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 826/1658] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:17.593190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:17.593826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:17.596276 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=56 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:17.601651 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.602164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.602603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.603299 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:17.603753 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:17.604179 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:17.663558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:17.671172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-231c6aab-913a-4e4c-8a70-65193d09ef5e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081827 Oct 02 01:23:17.671737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 833/1659] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:17 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:18.121320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:18.121848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:18.128250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.128725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.129159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.129844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.130322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.130744 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.190039 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:18.199651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-df447a2a-85ad-4851-967a-77599cb9865c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082225 Oct 02 01:23:18.200225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 827/1660] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:18.693252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:18.693868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:18.700367 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.700851 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.701288 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.701983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:18.702463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:18.702894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:18.763310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:18.771687 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a797414-946d-4908-a143-8da2b71406b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082255 Oct 02 01:23:18.772248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 834/1661] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:18 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:19.222746 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:19.223390 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:19.229997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:19.230512 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:19.230944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:19.231631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:19.232078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:19.232497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:19.293943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:19.302713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aa3dffb8-3209-42e3-9252-2718c8e46f31 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083760 Oct 02 01:23:19.303284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 828/1662] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:19.794427 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:19.795045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:19.802037 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:19.802544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:19.802982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:19.803699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:19.804154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:19.804574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:19.864508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:19.872423 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fbb45f30-9d86-4f1a-8a53-6f7e4a790b9d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081734 Oct 02 01:23:19.873024 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 835/1663] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:19 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:20.325658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:20.326317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:20.333338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:20.333823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:20.334298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.335007 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:20.335464 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:20.335897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.395559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:20.403679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2c162007-1595-4739-b312-471bff46a28f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081907 Oct 02 01:23:20.404246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 829/1664] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:20.894969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:20.895588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:20.902034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:20.902547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:20.902987 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.903681 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:20.904139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:20.904569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:20.964897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:20.973016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16d87b78-3e94-4916-a89e-c13beb93d6d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081909 Oct 02 01:23:20.973577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 836/1665] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:20 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:21.426054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:21.426689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:21.433026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.433504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.433937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:21.434676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:21.435125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:21.435544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:21.497730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:21.505991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-502c8850-2eed-4cc2-86d4-b753225231da tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083810 Oct 02 01:23:21.506529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 830/1666] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:21.996208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:21.996845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:22.003732 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:22.004202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:22.004629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:22.005306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:22.005754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:22.006214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:22.068136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:22.075753 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2cb974a0-51da-4182-978d-09f07af2bfba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083493 Oct 02 01:23:22.076312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 837/1667] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:21 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:22.528618 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:22.529242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:22.536238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:22.536722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:22.537159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:22.537852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:22.538461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:22.538890 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:22.598135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:22.606221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2005e329-43d5-4acc-b2f8-23f54784b27f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081440 Oct 02 01:23:22.606789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 831/1668] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:23.099737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:23.100353 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:23.106770 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.107247 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.107681 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.108365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.108820 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.109249 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.168224 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:23.175758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a25150de-fc6d-4f6a-992b-803ec258e4db tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080555 Oct 02 01:23:23.176313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 838/1669] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:23 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:23.629908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:23.630568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:23.637155 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.637656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.638124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.638831 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:23.639322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:23.639748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:23.701327 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:23.709559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c601542f-9eaa-44ef-b8c6-ce70b77522a3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084156 Oct 02 01:23:23.710130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 832/1670] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:24.198421 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:24.199029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:24.205448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:24.205927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:24.206394 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:24.207081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:24.207532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:24.207957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:24.267771 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:24.275466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8fca381-4827-4d93-99d1-0e6f5b33ed60 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080951 Oct 02 01:23:24.276029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 839/1671] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:24 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:24.731767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:24.732313 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:24.739006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:24.739509 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:24.739934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:24.740630 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:24.741121 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:24.741551 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:24.800795 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:24.808979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-31c492ab-70e6-421d-9d66-582bf98ba2f8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081191 Oct 02 01:23:24.809546 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 833/1672] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:25.299049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:25.299614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:25.306016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.306526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.306961 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.307650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.308097 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.308521 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.367860 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:25.375581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1ae1de0-b9a7-42bd-9a19-6b244b3cbedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080944 Oct 02 01:23:25.376769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 840/1673] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:25 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:25.832172 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:25.832783 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:25.839225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.839710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.840142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.840830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:25.841307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:25.841730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:25.903667 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:25.912354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f8cda7f1-a0b3-42d4-ac47-0ef3cfaf7983 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084481 Oct 02 01:23:25.912914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 834/1674] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:26.400390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:26.401067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:26.407492 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:26.407974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:26.408410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:26.409102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:26.409557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:26.409983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:26.469235 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:26.476818 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-919f1639-407b-4fc2-bc99-a26dd2b1dd5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080297 Oct 02 01:23:26.477399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 841/1675] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:26 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:26.933817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:26.934462 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:26.941568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:26.942049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:26.942507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:26.943200 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:26.943660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:26.944085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.004320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:27.012765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0ea4a5cf-b47e-4198-be12-c0ed16da7c33 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082563 Oct 02 01:23:27.013730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 835/1676] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:27.499290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:27.499934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:27.506408 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:27.506893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:27.507332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.508025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:27.508484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:27.508912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:27.568019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:27.575624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ea14fb8-2114-4e10-9950-96425c49428f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080198 Oct 02 01:23:27.576187 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 842/1677] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:27 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:28.035924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:28.036457 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:28.043144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.043647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.044085 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.044782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.045231 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.045656 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.113897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:28.116104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:28.123626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3ddc2a3d-b587-4388-83d8-1282a2fbcdc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.091589 Oct 02 01:23:28.124215 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 836/1678] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:28.599091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:28.599707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:28.606260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.606745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.607185 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.607885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:28.608340 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:28.608770 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:28.668480 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:28.676775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d094845c-d862-4dd2-9095-898d87e407f4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082012 Oct 02 01:23:28.677348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 843/1679] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:28 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:29.147363 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:29.147968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:29.154375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:29.154852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:29.155283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:29.155963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:29.156409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:29.156828 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:29.215805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:29.224428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7d2fd356-932c-48df-bf26-34a1727f63e8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080858 Oct 02 01:23:29.224993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 837/1680] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:29.699328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:29.699941 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:29.706547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:29.706962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:29.707390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:29.708109 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:29.708557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:29.708982 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:29.770178 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:29.772327 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:29.778984 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c820e2ee-3336-4e73-9fba-2715205c28b5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083566 Oct 02 01:23:29.779553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 844/1681] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:29 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:30.247395 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:30.248016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:30.254451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.254944 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.255383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.256075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.256529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.256956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.319627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:30.327869 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aa76ecd9-2208-4629-977b-1c6ea5c594e7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084397 Oct 02 01:23:30.328439 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 838/1682] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:30.801776 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:30.802414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:30.808849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.809329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.809758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:30.810470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:30.810915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:30.811332 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:31.022535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:31.030369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ca177ff-fb64-4903-8d28-99d879c19e5a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.232345 Oct 02 01:23:31.031157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 845/1683] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:30 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:31.350704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:31.351323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:31.357775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:31.358296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:31.358737 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:31.359427 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:31.359878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:31.361087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:31.422182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:31.433718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2e292d6e-33b6-43c5-885c-5de0cb8e96a0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.086840 Oct 02 01:23:31.434322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 839/1684] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:32.052711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:32.053323 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:32.059816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:32.060297 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:32.060735 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:32.061425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:32.061878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:32.062331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:32.121637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:32.129361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6dca6376-697c-47e1-b285-cc8517f8697c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080511 Oct 02 01:23:32.129908 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 846/1685] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:32 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:32.457141 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:32.457679 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:32.464164 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:32.464642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:32.465076 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:32.465770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:32.466274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:32.466701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:32.529375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:32.537498 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a7cc20d4-e46e-44dc-b61d-c23599de434e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084885 Oct 02 01:23:32.538079 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 840/1686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:33.152127 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:33.152732 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:33.159083 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:33.159558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:33.159986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:33.160670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:33.161116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:33.161534 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:33.220933 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:33.228581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bfc38680-fe2e-4dd2-b411-a0cb09b89b68 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080308 Oct 02 01:23:33.229131 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 847/1687] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:33 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:33.559549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:33.560171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:33.567116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:33.567599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:33.568037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:33.568732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:33.569187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:33.569616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:33.629030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:33.637111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7831a4a2-eb3d-40e1-931e-b8fc6416238f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081337 Oct 02 01:23:33.637678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 841/1688] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:34.251676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:34.252282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:34.258752 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:34.259228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:34.259656 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:34.260341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:34.260790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:34.261210 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:34.320792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:34.328398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb6643c1-18d0-4ea0-9568-1af26848aedf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080690 Oct 02 01:23:34.329478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 848/1689] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:34 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:34.658834 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:34.659391 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:34.665792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:34.666338 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:34.666779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:34.667478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:34.667935 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:34.668368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:34.730596 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:34.739142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-68416a40-c22a-48c6-b427-5e7852492f25 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084216 Oct 02 01:23:34.739727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 842/1690] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:35.351575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:35.352113 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:35.358963 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.359446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.359879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.361454 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.361909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.362362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.424447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:35.432033 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aaa1546d-09b7-463d-8b51-dc5ebee09517 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084339 Oct 02 01:23:35.432578 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 849/1691] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:35 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:35.761916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:35.762571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:35.769489 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.769976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.770442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.771138 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:35.771628 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:35.772054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:35.832049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:35.840066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5c9afd15-73f5-427b-95d3-06599260317c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082024 Oct 02 01:23:35.840633 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 843/1692] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:36.454616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:36.455495 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:36.465981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:36.466487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:36.466917 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:36.467606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:36.468053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:36.468503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:36.529785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:36.537355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f6d59b8-7a54-4c62-b994-413aaf658c6a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.086629 Oct 02 01:23:36.537898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 850/1693] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:36 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:36.863096 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:36.863709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:36.870144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:36.870625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:36.871086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:36.871768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:36.872213 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:36.872631 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:36.934863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:36.943043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-41a20d53-77f8-41c2-b9c8-5b6fb4705d15 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084780 Oct 02 01:23:36.943605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 844/1694] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:37.560267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:37.560871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:37.567715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:37.568184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:37.568612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:37.569287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:37.569729 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:37.570187 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:37.630104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:37.638197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a17396a-f523-44ef-9610-044558fe7a3c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081765 Oct 02 01:23:37.638751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 851/1695] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:37 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:37.965125 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:37.965758 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:37.972212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:37.972691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:37.973129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:37.973836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:37.974297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:37.974720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:38.034849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:38.043185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dadf920f-6763-4d4d-9cdd-d34a1b47f919 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081936 Oct 02 01:23:38.043741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 845/1696] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:38.661221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:38.661859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:38.668315 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:38.668790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:38.669221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:38.669900 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:38.670376 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:38.670794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:38.730015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:38.738440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-746296ff-e148-4bfc-8aff-3c489386ef72 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081023 Oct 02 01:23:38.738994 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 852/1697] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:38 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:39.065554 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:39.066184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:39.072604 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:39.073088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:39.073526 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.074254 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:39.074711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:39.075147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.140190 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:39.148446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7544b25f-9eb8-4b50-bbda-ad93b520a4f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.086880 Oct 02 01:23:39.149013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 846/1698] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:39.761736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:39.762366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:39.769697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:39.770204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:39.770638 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.771326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:39.771776 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:39.772222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:39.832765 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:39.840433 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b21e2b06-93a0-4285-8a02-f1dc0e861ac7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082564 Oct 02 01:23:39.840989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 853/1699] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:39 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:40.171111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:40.171747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:40.178660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.179137 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.179568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.180251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.180697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.181117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.241280 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:40.249345 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-af1c65cb-f78f-4efc-baed-b4c89059e7be tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082080 Oct 02 01:23:40.249910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 847/1700] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:40.863557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:40.864155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:40.870555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.871036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.871470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.872167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:40.872620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:40.873048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:40.932671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:40.941132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d694cba4-21f5-4a39-9821-2537dbe60333 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082141 Oct 02 01:23:40.941675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 854/1701] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:40 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:41.273453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:41.274086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:41.280572 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.281043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.281472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.282697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.283139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.283843 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.346035 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:41.354099 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-62152f45-ea6e-48b0-87d2-9a78100cc333 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084436 Oct 02 01:23:41.354671 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 848/1702] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:41.963745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:41.964355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:41.971244 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.971725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.972161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:41.972853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:41.973302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:41.973728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:42.033733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:42.041855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1c4c17b-3d19-4d6d-aae0-fcd05f30d2a9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082151 Oct 02 01:23:42.042446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 855/1703] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:41 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:42.377430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:42.378050 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:42.384642 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:42.385124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:42.385567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:42.386292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:42.386747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:42.387176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:42.447979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:42.456013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b9a59aec-6a70-4943-b56c-0387bc4d5959 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083079 Oct 02 01:23:42.456581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 849/1704] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:43.064428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:43.065036 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:43.071419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:43.071894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:43.072325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:43.073002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:43.073450 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:43.073864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:43.135478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:43.143446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-edeaf769-56c8-464c-93fa-5623495cbfe7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082917 Oct 02 01:23:43.143999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 856/1705] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:43 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:43.478485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:43.479110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:43.485159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:43.485901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:43.486380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:43.487081 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:43.487541 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:43.487974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:43.550936 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:43.559174 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4b20e6c0-3819-4ea3-b7b0-e779800aab24 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084735 Oct 02 01:23:43.559743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 850/1706] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:44.166169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:44.166790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:44.173688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.174183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.174618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:44.175293 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.175737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.176156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:44.236597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:44.244133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f360f330-2cbe-44a5-b1c4-1d72a42fabfc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081853 Oct 02 01:23:44.244683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 857/1707] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:44 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:44.582939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:44.583518 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:44.589781 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.590295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.590734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:44.591421 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:44.591867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:44.592284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:44.653320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:44.662028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8f28b62c-b69f-4c91-af21-5cb46a3c467f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083634 Oct 02 01:23:44.662619 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 851/1708] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:45.267246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:45.267875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:45.274300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:45.274784 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:45.275222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:45.275915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:45.276372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:45.276803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:45.336691 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:45.344348 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-390f83d9-d582-4268-a76e-b2d2d7dd84fe tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081526 Oct 02 01:23:45.344903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 858/1709] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:45 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:45.684293 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:45.684927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:45.691856 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:45.692332 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:45.692766 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:45.693448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:45.693898 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:45.694346 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:45.757329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:45.765381 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-fc828687-4f8e-4bd3-969f-5dd9d7361194 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085032 Oct 02 01:23:45.766010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 852/1710] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:46.367270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:46.367828 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:46.374282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:46.374768 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:46.375232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:46.375920 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:46.376374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:46.376793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:46.437708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:46.445354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48ba7413-89a1-4a82-bac9-37651a1cb73d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082064 Oct 02 01:23:46.445914 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 859/1711] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:46 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:46.787329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:46.787947 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:46.790312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=56 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:46.795709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:46.796189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:46.796620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:46.797308 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:46.797757 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:46.798214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:46.813817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:46.861424 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:46.869675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e92ad961-dd55-46a2-b887-cbd81f3a5bc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.086161 Oct 02 01:23:46.870259 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 853/1712] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:47.467910 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:47.468545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:47.475547 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:47.478079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:47.478529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:47.479269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:47.479839 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:47.480397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:47.541189 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:47.549445 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8dc66fae-c2e4-4c30-b668-2d0003d1e45d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085449 Oct 02 01:23:47.549997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 860/1713] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:47 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:47.892943 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:47.893555 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:47.899955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:47.900441 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:47.900877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:47.901574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:47.902032 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:47.902487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:47.964992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:47.973809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cf6fb9ff-ab3b-4601-9749-eadc7a0bbc41 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085373 Oct 02 01:23:47.974414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 854/1714] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:48.571620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:48.572234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:48.574593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=56 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:48.580446 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:48.580930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:48.581364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:48.582078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:48.582540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:48.582967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:48.599968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:23:48.646252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:48.653855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-911295a3-f86c-40ff-ab09-7fcdcbb50d2d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.086087 Oct 02 01:23:48.654455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 861/1715] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:48 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:48.995894 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:48.996504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:49.004942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:49.005419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:49.005851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:49.006570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:49.007018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:49.007438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:49.067020 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:49.075098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d78aceba-43b3-4808-a329-36e647996031 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083107 Oct 02 01:23:49.075658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 855/1716] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:49.677390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:49.677996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:49.684478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:49.684953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:49.685399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:49.686077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:49.686536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:49.686983 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:49.746402 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:49.753937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72b0868e-33be-41d7-8d17-ca36edf3d450 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080450 Oct 02 01:23:49.754523 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 862/1717] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:49 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:50.098868 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:50.099474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:50.105938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.106453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.106894 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.107591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.108048 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.108478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.171252 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:50.179475 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d9ad1d4e-4d20-4a1c-8746-f8c5d464b7af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084512 Oct 02 01:23:50.180045 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 856/1718] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:50.776086 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:50.777386 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:50.783875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.784350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.784777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.785459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:50.785938 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:50.786378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:50.847610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:50.855234 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4a89216e-fb10-4c2c-80f3-bbed1eb0e1b3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083137 Oct 02 01:23:50.855800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 863/1719] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:50 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:51.202006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:51.202658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:51.209177 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:51.209664 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:51.210122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:51.210820 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:51.211277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:51.211704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:51.271919 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:51.279934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3cf0ae7e-e811-4f5a-a0cd-c7803e43ea89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081779 Oct 02 01:23:51.280494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 857/1720] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:51.878416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:51.879026 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:51.885483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:51.885960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:51.886436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:51.887126 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:51.887577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:51.888001 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:51.947773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:51.955414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f136360d-c223-4815-9546-c17b2a886a55 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080889 Oct 02 01:23:51.955975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 864/1721] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:51 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:52.302707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:52.303323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:52.309809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.310322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.310755 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.311445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.311893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.312317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.376108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:52.384147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-72f82cd4-5979-414a-b686-b4925456efb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085268 Oct 02 01:23:52.384703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 858/1722] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:52.979161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:52.979777 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:52.987047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.987529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.987965 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:52.988655 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:52.989106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:52.989531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:53.050370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:53.058050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30c0f1ad-3688-4c41-a463-fbfc24f5f96c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082810 Oct 02 01:23:53.058630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 865/1723] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:52 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:23:53.407479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:53.408095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:53.414529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:53.415001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:53.415432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:53.416116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:53.416562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:53.416981 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:53.476570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:53.485371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6012371b-961c-45e5-adef-1cb742eb1847 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081628 Oct 02 01:23:53.486209 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 859/1724] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:54.081902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:54.082572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:54.089123 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:54.089611 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:54.090052 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:54.090773 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:54.091228 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:54.091654 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:54.151569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:54.159605 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-73a2e7dd-cd5c-4412-b673-347370b38b28 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082093 Oct 02 01:23:54.160107 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 866/1725] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:54 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:54.508645 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:54.509262 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:54.515794 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:54.516279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:54.516715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:54.517403 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:54.517864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:54.518322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:54.582817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:54.591079 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-901cc608-fdc4-41b0-a7ca-be0189a69a7d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.086240 Oct 02 01:23:54.591672 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 860/1726] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:55.182135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:55.182748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:55.189125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.189607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.190045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.190764 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.191216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.191649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.251240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:55.258976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0261f352-9a6c-4a83-8dc0-40077d7c3bba tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080705 Oct 02 01:23:55.259545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 867/1727] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:55 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:55.614556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:55.615170 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:55.621534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.622012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.622479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.623202 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:55.623655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:55.624093 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:55.684812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:55.693566 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-78d9a88d-116e-4421-b74a-dcf8dad9ab42 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083369 Oct 02 01:23:55.694150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 861/1728] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:56.282283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:56.282898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:56.289479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:56.289905 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:56.290378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:56.291074 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:56.291529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:56.291954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:56.351354 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:56.359029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-99122503-f883-4fff-9a9b-40f51190f342 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080734 Oct 02 01:23:56.359582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 868/1729] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:56 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:56.716700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:56.717512 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:56.723962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:56.724439 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:56.724872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:56.725562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:56.726012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:56.726463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:56.789516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:56.798199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-92840e27-8a2d-4a33-8974-e472bb35f89d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085361 Oct 02 01:23:56.798771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 862/1730] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:57.381625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:57.382190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:57.388610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.389085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.389512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:57.390226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.391166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.391586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:57.452737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:57.460810 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef41849c-fb63-4262-acaa-cf588213e868 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083119 Oct 02 01:23:57.461377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 869/1731] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:57 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:57.820743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:57.821354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:57.828637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.829128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.829560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:57.830282 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:57.830729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:57.831148 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:57.891591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:57.899565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-35c09a2d-101d-406a-8b41-5ec09c9f9dee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082645 Oct 02 01:23:57.900122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 863/1732] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:58.483880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:58.485029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:58.491720 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:58.492200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:58.492633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:58.493322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:58.493775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:58.494238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:58.553022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:58.561131 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-771cead6-045d-4f7d-8f81-f5e2a5103785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081109 Oct 02 01:23:58.561746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 870/1733] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:58 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:58.922031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:58.922777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:58.929185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:58.929668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:58.930124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:58.930821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:58.931271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:58.931697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:58.996734 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:59.004960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-32654f7e-7cae-4932-a9e9-3f217dc2881a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.086792 Oct 02 01:23:59.005525 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 864/1734] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:23:59.583047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:23:59.583660 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:23:59.590748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:59.591229 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:59.591662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:59.592347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:23:59.592795 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:23:59.593216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:23:59.653775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:23:59.661440 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c0c93ab-c7e9-447f-9590-f4878cb89a6c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082278 Oct 02 01:23:59.662002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 871/1735] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:23:59 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:00.027876 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:00.028497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:00.035456 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:00.036230 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:00.036353 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:00.037054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:00.037510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:00.037936 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:00.097275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:00.105373 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4afc6744-9a9f-4306-bc07-4c843931b79c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081420 Oct 02 01:24:00.105940 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 865/1736] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:00.684355 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:00.685006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:00.691734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:00.692245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:00.692676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:00.693364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:00.693810 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:00.694267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:00.754275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:00.761711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f5a6b72b-42b0-4a03-a9d8-0655b74d4302 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081261 Oct 02 01:24:00.762296 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 872/1737] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:00 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:01.129285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:01.129912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:01.136343 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:01.136826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:01.137263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:01.137996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:01.138482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:01.138911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:01.201185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:01.209325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-872c8601-fed0-4882-97b4-1bf775f21b63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084560 Oct 02 01:24:01.209906 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 866/1738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:01.785514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:01.786142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:01.792733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:01.793221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:01.793661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:01.794390 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:01.794850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:01.795282 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:01.855580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:01.863599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9650456-a6fc-4c52-b158-575757bc63ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082533 Oct 02 01:24:01.864188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 873/1739] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:01 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:02.231617 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:02.232229 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:02.238900 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:02.239384 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:02.239829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:02.240523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:02.241000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:02.241428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:02.300649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:02.308833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-446ad81b-dca8-45e5-aa8b-e8f9ece6fc2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081141 Oct 02 01:24:02.309401 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 867/1740] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:02.886161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:02.886812 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:02.893176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:02.893654 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:02.894114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:02.894804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:02.895278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:02.895682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:02.955028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:02.962694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e96881d1-3f19-40e8-bc6c-e84a2f575570 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080540 Oct 02 01:24:02.963250 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 874/1741] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:02 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:03.332263 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:03.332870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:03.339324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:03.339805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:03.340234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:03.340915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:03.341386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:03.341805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:03.404001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:03.412582 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bc2980e6-607b-47bf-9661-5c44173734cb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084665 Oct 02 01:24:03.413142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 868/1742] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:03.986247 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:03.986854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:03.993231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:03.993704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:03.994156 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:03.994842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:03.995291 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:03.995712 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:04.056197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:04.064262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-528053c4-deb5-461f-a199-a0571aae3206 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082189 Oct 02 01:24:04.064830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 875/1743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:03 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:04.434939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:04.435545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:04.442797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:04.443305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:04.443742 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:04.444437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:04.444891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:04.445317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:04.505054 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:04.513152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2db57d5d-a62f-4932-af83-b8d3faada528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082001 Oct 02 01:24:04.513719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 869/1744] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:05.086482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:05.087088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:05.094254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:05.094730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:05.095187 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:05.095878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:05.096337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:05.096758 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:05.159723 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:05.167310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1a30b3c-cc14-455f-8c09-7f85ac3a4d40 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084643 Oct 02 01:24:05.167859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 876/1745] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:05 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:05.536110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:05.536726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:05.543152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:05.543633 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:05.544071 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:05.544760 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:05.545211 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:05.545634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:05.548867 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:05.608709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:05.617093 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e8081b0e-0c84-4b15-903d-b60defaaa0a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084813 Oct 02 01:24:05.617653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 870/1746] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:06.190235 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:06.190755 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:06.197076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:06.197553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:06.197981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:06.198684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:06.199132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:06.199552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:06.258869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:06.267006 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e2efab0-439b-45e5-aa26-5f9d11bcb6a3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081172 Oct 02 01:24:06.267554 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 877/1747] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:06 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:06.639442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:06.640134 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:06.646928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:06.647405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:06.647835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:06.648527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:06.648973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:06.649394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:06.708354 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:06.716288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2637760d-182e-4a4b-90e8-5d519a2e2c92 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080697 Oct 02 01:24:06.716850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 871/1748] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:07.289648 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:07.290213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:07.296494 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:07.296967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:07.297394 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:07.298101 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:07.298551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:07.298969 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:07.302794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:07.358338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:07.366215 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1aa44482-60fa-4570-aaae-113acd70c135 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080439 Oct 02 01:24:07.366772 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 878/1749] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:07 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:07.739591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:07.740152 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:07.746777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:07.747257 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:07.747689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:07.748376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:07.748826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:07.749243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:07.811380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:07.819993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3aeeee3a-2fc9-41e3-a374-a1872da29ef0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084644 Oct 02 01:24:07.820551 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 872/1750] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:08.388654 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:08.389262 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:08.395711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:08.396197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:08.396769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:08.397469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:08.397923 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:08.398381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:08.459507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:08.467698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7cd99f95-c9f9-4e6a-86a4-2a21f9f98a5b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082793 Oct 02 01:24:08.468681 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 879/1751] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:08 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:08.842872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:08.844017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:08.850335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:08.850811 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:08.851243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:08.851931 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:08.852374 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:08.852792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:08.912288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:08.920199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-00e6305a-cda9-4cb5-a499-8ddcb9b533e3 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081219 Oct 02 01:24:08.920753 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 873/1752] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:08 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:09.491057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:09.491670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:09.498025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:09.498535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:09.498972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:09.500233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:09.500685 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:09.501109 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:09.562697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:09.570391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2bc635e1-0b45-476d-8c9f-5260e7171c8c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083203 Oct 02 01:24:09.571172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 880/1753] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:09 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:09.942756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:09.943400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:09.949898 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:09.950412 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:09.950845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:09.951529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:09.951988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:09.952400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:10.015578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:10.023683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5ec7b918-742c-44a0-ba17-0e3e6fb4bfd2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084777 Oct 02 01:24:10.024238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 874/1754] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:10.592608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:10.593236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:10.599600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:10.600081 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:10.600516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:10.601201 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:10.601654 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:10.602099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:10.661630 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:10.669316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bbefaa20-6697-4db1-80c7-0fad8fbc66d7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080521 Oct 02 01:24:10.670119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 881/1755] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:10 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:11.046996 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:11.047601 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:11.053998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:11.054505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:11.054934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:11.055623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:11.056068 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:11.056484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:11.116535 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:11.125201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ae1e1e9c-7861-4238-aad0-2aa9d20f9369 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081880 Oct 02 01:24:11.125762 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 875/1756] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:11.692639 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:11.693257 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:11.699851 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:11.700334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:11.700771 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:11.701468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:11.701925 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:11.702404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:11.763902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:11.771458 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93a66d6c-01c0-4522-a84d-e6133f279ac5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082742 Oct 02 01:24:11.772007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 882/1757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:11 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:12.147799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:12.148406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:12.154800 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.155276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.156192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.156902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.157349 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.157776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.219372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:12.227372 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d875892a-9433-47bb-8754-ba0599f25612 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083432 Oct 02 01:24:12.227929 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 876/1758] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:12.794478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:12.795087 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:12.801004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.801486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.801921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.802643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:12.803092 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:12.803516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:12.862579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:12.870200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ece09011-5e23-4291-9128-5bbf29168f2a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.079726 Oct 02 01:24:12.870756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 883/1759] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:12 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:13.251162 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.251769 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:13.257939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.258450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.258882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.259565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.260014 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.260432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.319376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:13.327765 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8908dc6a-37f8-419f-adb8-114fa7db7c4b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081013 Oct 02 01:24:13.328337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 877/1760] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:13.894002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:13.894724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:13.901702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.902232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.902673 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.903370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:13.903825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:13.904251 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:13.966478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:13.974269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea8d2af8-0755-4ee9-b7be-d812f4e9c95e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084851 Oct 02 01:24:13.974837 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 884/1761] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:13 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:14.350195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:14.350968 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:14.357530 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:14.358005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:14.359108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:14.359798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:14.360504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:14.360931 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:14.423290 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:14.431392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-de67f69c-2e5b-4605-8bda-b652b17521af tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085158 Oct 02 01:24:14.431947 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 878/1762] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:14.997968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:14.998601 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:15.005671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:15.006182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:15.006612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:15.007290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:15.007736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:15.008158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:15.068884 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:15.076696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a701d01-b520-4a4e-8fd9-8c2bcf69f371 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082583 Oct 02 01:24:15.077919 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 885/1763] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:14 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:15.453731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:15.454269 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:15.460709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:15.461184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:15.461611 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:15.462323 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:15.462767 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:15.463184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:15.522529 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:15.530543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b846f672-bd0a-4949-8383-bb4510913d1e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080640 Oct 02 01:24:15.531113 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 879/1764] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:16.099997 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:16.100608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:16.107034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:16.107518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:16.107953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:16.108707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:16.109161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:16.109584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:16.170597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:16.178867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a5c8deb0-72ba-4faa-88be-f3d009ea0048 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082677 Oct 02 01:24:16.179424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 886/1765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:16 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:16.552725 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:16.553397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:16.559775 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:16.560254 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:16.560688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:16.561377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:16.562371 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:16.562803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:16.625586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:16.633690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-12e2f918-c7cc-42c4-b95c-eb95401d21ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084831 Oct 02 01:24:16.634288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 880/1766] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:17.202021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:17.202929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:17.209295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:17.209776 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:17.210255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:17.210954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:17.211407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:17.211831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:17.272321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:17.279834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-292cf242-410a-4fcf-9394-7ec5a160e8ff tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082903 Oct 02 01:24:17.281103 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 887/1767] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:17 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:17.657398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:17.658009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:17.660317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=56 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:17.665493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:17.665976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:17.666437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:17.667129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:17.667580 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:17.668003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:17.728637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:17.737033 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ab43c72e-6610-47c0-bf93-aab14093cfb1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084133 Oct 02 01:24:17.737601 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 881/1768] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:18.303302 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:18.303858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:18.310311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:18.310793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:18.311225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:18.312406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:18.312856 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:18.313280 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:18.372676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:18.381230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc1c88ce-758b-41a7-97f5-f389fdfa009b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081887 Oct 02 01:24:18.381793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 888/1769] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:18 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:18.759445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:18.760062 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:18.766496 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:18.766976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:18.767799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:18.768139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:18.768545 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:18.768975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:18.831569 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:18.839704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cb0cd5be-84a3-4656-b6a1-e2573ec37876 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084126 Oct 02 01:24:18.840267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 882/1770] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:24:19.403895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:19.404438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:19.407466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=56 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:19.412595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:19.413077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:19.413513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:19.414243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:19.414701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:19.415129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:19.476410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:19.484154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bfc0f07b-45d6-45a4-bebc-6b83e339e78f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084194 Oct 02 01:24:19.484717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 889/1771] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:19 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:19.863283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:19.863907 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:19.870312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:19.870789 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:19.871221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:19.871908 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:19.872358 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:19.872782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:19.931802 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:19.940543 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9aec9b9c-3ae0-41f7-a88d-277c8f321d6a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081435 Oct 02 01:24:19.941312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 883/1772] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:20.507273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:20.507878 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:20.514259 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:20.514734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:20.515163 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:20.515838 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:20.516285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:20.516708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:20.576040 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:20.584144 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a386a31c-7605-480f-894d-ddba30593b20 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080724 Oct 02 01:24:20.584692 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 890/1773] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:20 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:20.962124 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:20.962646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:20.969872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:20.970377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:20.970806 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:20.971488 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:20.971938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:20.972355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:21.034720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:21.042951 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f27aa451-f6a7-416a-a353-694d224f24d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084712 Oct 02 01:24:21.043522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 884/1774] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:21.607221 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:21.607822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:21.614945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:21.615417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:21.615846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:21.616526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:21.616971 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:21.617417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:21.676503 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:21.684028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-400bce03-6242-4c87-af9d-c099960bcaf7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080631 Oct 02 01:24:21.684580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 891/1775] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:21 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:22.065212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:22.065829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:22.072271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:22.072748 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:22.073172 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:22.073861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:22.074333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:22.074753 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:22.135484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:22.143887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c5d88c6c-7d8a-4da2-bb6e-327043ba4caf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082549 Oct 02 01:24:22.144449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 885/1776] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:22.707548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:22.708147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:22.714678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:22.715150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:22.715577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:22.716254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:22.716703 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:22.717119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:22.776295 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:22.783790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-660b095f-b34c-41f5-bf57-4a41c60e1f3d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080092 Oct 02 01:24:22.784339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 892/1777] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:22 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:23.166636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:23.167282 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:23.174243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:23.174731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:23.175173 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:23.175872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:23.176329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:23.176761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:23.239594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:23.241736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:23.249074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bfcba741-9a1c-405f-9b06-6c7c70b9d88d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.086293 Oct 02 01:24:23.249639 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 886/1778] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:23.806245 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:23.806850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:23.813229 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:23.813702 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:23.814155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:23.814844 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:23.815310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:23.815716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:23.874897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:23.882545 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e52e3af2-38d4-4e28-9909-1da0fa9d2c17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080265 Oct 02 01:24:23.883102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 893/1779] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:23 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:24.271716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:24.272333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:24.279217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:24.279707 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:24.280147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:24.280844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:24.281302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:24.281731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:24.341647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:24.350045 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-118f2190-de9f-4f28-a9a1-c4e33eb53887 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082208 Oct 02 01:24:24.350641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 887/1780] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:24.904716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:24.905791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:24.912261 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:24.912739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:24.913168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:24.913852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:24.914321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:24.914741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:24.974399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:24.976533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:24.983759 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2fd626c1-9a28-412c-8dd2-f84d93cef5cd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082318 Oct 02 01:24:24.984312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 894/1781] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:24 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:25.372852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:25.373470 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:25.379958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:25.380438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:25.380874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:25.381562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:25.382013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:25.382463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:25.444292 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:25.452901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-be691235-0ae0-470a-a90e-b2ae2f8839e1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083974 Oct 02 01:24:25.453459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 888/1782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:26.006733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:26.007336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:26.013716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:26.014264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:26.014711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:26.015403 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:26.015859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:26.016287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:26.078807 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:26.086448 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cb4905d-3760-4aec-b814-04461ed7042d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083801 Oct 02 01:24:26.087014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 895/1783] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:26 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:26.476189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:26.476723 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:26.484083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:26.484558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:26.484991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:26.485938 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:26.486422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:26.486845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:26.546622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:26.554659 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f4e98e53-3950-4837-a19f-8a8a030a7360 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082520 Oct 02 01:24:26.555226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 889/1784] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:27.108665 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:27.109278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:27.116050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.116532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.116967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.117659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.118144 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.118575 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.177774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:27.185380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a5f85d31-2eba-44c6-9cbf-343fe592e51b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080570 Oct 02 01:24:27.186439 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 896/1785] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:27 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:27.577075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:27.577710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:27.584117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.584592 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.585025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.585708 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:27.586185 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:27.586610 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:27.652625 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:27.660759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-035ff4e6-5793-4716-8c1b-664bb7ee5035 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.087677 Oct 02 01:24:27.661315 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 890/1786] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:28.208664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:28.209275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:28.215711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.216190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.216626 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.217967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.218452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.218888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.278102 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:28.286450 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-672142ca-2ab4-40ed-b560-9e43eecaf091 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081580 Oct 02 01:24:28.286952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 897/1787] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:28 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:28.684106 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:28.684645 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:28.691586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.692065 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.692501 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.693189 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:28.693643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:28.694083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:28.753866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:28.761894 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cd95addf-c4bc-4226-b2e4-fe6e4d4e0aaa tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081692 Oct 02 01:24:28.762495 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 891/1788] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:29.308888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:29.309437 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:29.315815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.316297 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.316730 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.317417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.317868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.318316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.378079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:29.385652 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f54a2f89-892e-4936-a2f6-55bf28b95e84 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080745 Oct 02 01:24:29.386305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 898/1789] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:29 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:29.784712 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:29.785319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:29.791711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.792187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.792621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.793302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:29.793751 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:29.794195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:29.855429 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:29.863821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-63c82643-04ff-4ccc-ae63-ec8a24a45690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082960 Oct 02 01:24:29.864385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 892/1790] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:30.408283 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:30.408902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:30.415538 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:30.416016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:30.416447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:30.417161 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:30.417606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:30.418022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:30.477671 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:30.486021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-036512bd-2877-4e89-8100-24adab67fbe8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081661 Oct 02 01:24:30.486599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 899/1791] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:30 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:30.885818 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:30.886481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:30.893520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:30.894009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:30.894484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:30.895184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:30.895641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:30.896072 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:30.955710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:30.963855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ea06d9cf-eb47-49c0-8e17-8dbe0073ec8b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081883 Oct 02 01:24:30.964420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 893/1792] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:31.509015 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:31.509631 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:31.516100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.516582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.517021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:31.517711 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.518190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.518623 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:31.578216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:31.585855 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8826b2f1-1384-4271-9b62-94f119cf3a41 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080727 Oct 02 01:24:31.586450 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 900/1793] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:31 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:31.986453 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:31.987069 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:31.993572 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.994075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.994523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:31.995243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:31.995697 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:31.996123 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:32.058000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:32.066347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bffa6ac0-5519-48f1-882c-ffe117fc4a83 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084019 Oct 02 01:24:32.066910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 894/1794] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:32.609362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:32.610423 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:32.616894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:32.617384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:32.617824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:32.618615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:32.619077 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:32.619508 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:32.678808 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:32.687094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa6029e2-e965-4cb3-85a2-4a43c43a6dcc tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082177 Oct 02 01:24:32.687661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 901/1795] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:32 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:33.089109 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:33.089721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:33.096675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:33.097154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:33.097591 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:33.098320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:33.098807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:33.099232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:33.159897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:33.168057 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3c910d9c-aab9-4f99-98a7-8389fbcbe4f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082812 Oct 02 01:24:33.168622 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 895/1796] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:33.709441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:33.710046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:33.716551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:33.717640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:33.718085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:33.718805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:33.719254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:33.719674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:33.784021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:33.791628 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c2908b54-8503-4c13-aad4-9e686b16ea17 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.086107 Oct 02 01:24:33.792188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 902/1797] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:33 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:34.191484 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:34.192093 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:34.198460 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:34.198946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:34.199379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:34.200070 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:34.200523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:34.200950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:34.262658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:34.270753 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f173ff9d-0cc4-4f38-8085-9f40ff796bf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083175 Oct 02 01:24:34.271322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 896/1798] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:34.814054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:34.814707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:34.821134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:34.821615 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:34.822053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:34.822767 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:34.823238 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:34.823662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:34.883170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:34.891336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9cc1e5a-3b77-416d-8b86-7cae56f71ec7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081165 Oct 02 01:24:34.891896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 903/1799] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:34 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:35.293812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:35.294411 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:35.300878 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.301351 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.301782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:35.302504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.302954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.303374 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:35.363115 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:35.371055 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-552aeb1a-9980-4e7f-baba-88aa9b8fcbf9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081159 Oct 02 01:24:35.372385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 897/1800] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:35.914428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:35.915044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:35.922008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.922519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.922958 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:35.923653 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:35.924114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:35.924544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:35.985462 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:35.993256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9b5e78f1-e349-4ccc-ba7d-df486f5700b7 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082796 Oct 02 01:24:35.993821 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 904/1801] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:35 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:36.394312 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:36.394925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:36.401318 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:36.401797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:36.402267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:36.402950 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:36.403399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:36.403818 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:36.465251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:36.473989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a29bd76d-1bbd-4518-b816-32f49a450c54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083561 Oct 02 01:24:36.474605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 898/1802] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:37.016574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:37.017186 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:37.023606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:37.024085 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:37.024520 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:37.025212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:37.025666 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:37.026116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:37.086151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:37.093760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8260231-0895-444d-a3ff-d672b04bf6c3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081640 Oct 02 01:24:37.094358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 905/1803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:37 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:37.496675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:37.497294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:37.503819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:37.504297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:37.504732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:37.505422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:37.505874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:37.506328 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:37.565957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:37.574136 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-dd96aa34-071a-45fd-8761-5c3a0b3ef26f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081305 Oct 02 01:24:37.574704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 899/1804] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:38.116865 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:38.117476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:38.123879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:38.124360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:38.124796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:38.125486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:38.125943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:38.126396 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:38.185328 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:38.193675 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4add0b1b-bc99-44f8-96ff-ac4bf98710ac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080643 Oct 02 01:24:38.194307 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 906/1805] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:38 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:38.596382 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:38.597120 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:38.603620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:38.604104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:38.604580 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:38.605276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:38.605732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:38.606193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:38.667913 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:38.676485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ea0ae665-4b4a-48f2-9531-c92582242173 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083951 Oct 02 01:24:38.677051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 900/1806] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:39.217375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:39.217986 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:39.224647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:39.225128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:39.225563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:39.226292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:39.226748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:39.227173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:39.287819 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:39.296197 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b8b35c7-671f-4bcb-b37a-a2bbaaeb31c4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083236 Oct 02 01:24:39.296769 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 907/1807] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:39 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:39.699799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:39.700413 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:39.707365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:39.707851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:39.708291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:39.708982 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:39.709435 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:39.709862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:39.770652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:39.778879 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d038c5d8-41a6-46eb-b9d4-2cae418615ba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082934 Oct 02 01:24:39.779485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 901/1808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:40.318990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:40.319538 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:40.325949 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:40.326463 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:40.326898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:40.327586 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:40.328046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:40.328471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:40.390136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:40.397693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-471257e9-bed8-410f-b789-b0f1db52bdde tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082656 Oct 02 01:24:40.398285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 908/1809] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:40 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:40.801839 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:40.802516 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:40.808978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:40.809459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:40.809896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:40.810649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:40.811111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:40.811540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:40.873927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:40.882858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-582f5ec4-b511-4325-bfdb-29b2ef93a24d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084856 Oct 02 01:24:40.883426 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 902/1810] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:41.421774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:41.422432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:41.429842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:41.430368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:41.430805 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:41.431518 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:41.431973 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:41.432399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:41.546593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:41.554341 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf7c3732-e65d-4159-805d-1a5e53df834b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.137986 Oct 02 01:24:41.554899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 909/1811] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:41 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:41.906540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:41.907072 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:41.913429 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:41.913912 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:41.914389 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:41.915091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:41.915547 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:41.915977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:41.931715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:41.977894 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:41.986877 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-014d2249-9f7d-4cdc-967b-7297b770910e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084301 Oct 02 01:24:41.987443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 903/1812] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:42.577790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:42.578429 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:42.584513 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:42.584993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:42.585424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:42.586128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:42.586581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:42.587000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:42.645565 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:42.653088 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c74d517-da64-422d-989a-e3a322f7f8ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.079660 Oct 02 01:24:42.653641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 910/1813] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:42 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:43.009201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:43.009821 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:43.011960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:24:43.012105 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:24:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 (ip 10.222.0.25) !!! Oct 02 01:24:43.019100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:43.019583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:43.020022 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:43.020715 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:43.021169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:43.021599 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:43.084998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:43.093005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bc10d9e5-19d3-4d2d-bd94-46f8c8987cd8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.087835 Oct 02 01:24:43.093560 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 904/1814] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:43.676151 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:43.676920 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:43.685329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:43.685803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:43.686274 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:43.686962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:43.687410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:43.687829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:43.702365 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:43.748375 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:43.755832 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7238f388-3848-4966-bea4-76ebd48cdd99 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083524 Oct 02 01:24:43.756382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 911/1815] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:43 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:44.115960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:44.116577 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:44.123089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:44.123572 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:44.124010 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:44.124703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:44.125153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:44.125576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:44.186811 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:44.194884 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7d2949cf-c14d-4650-8c8d-306c0abc8511 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082817 Oct 02 01:24:44.195444 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 905/1816] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:44.778437 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:44.779054 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:44.785530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:44.786008 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:44.786473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:44.787167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:44.787622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:44.788043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:44.847658 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:44.855337 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05ad105e-de53-4aa5-b825-96f10d0baddf tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080860 Oct 02 01:24:44.855888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 912/1817] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:44 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:45.218305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:45.218922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:45.225272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:45.225747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:45.226287 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:45.226978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:45.227430 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:45.227852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:45.289731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:45.298571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-08c563f6-e134-46f6-8a8c-b28ff9c53d49 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084702 Oct 02 01:24:45.299133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 906/1818] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:45.878699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:45.879311 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:45.885793 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:45.886309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:45.886747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:45.887438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:45.887891 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:45.888319 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:45.947788 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:45.955467 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62a65678-5b53-4eee-8364-32d24ec6ee6e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080640 Oct 02 01:24:45.956021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 913/1819] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:45 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:46.320983 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:46.321603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:46.328647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:46.329133 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:46.329561 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:46.330283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:46.330732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:46.331151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:46.393307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:46.401436 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7d8a56a0-2d17-4879-9a02-89e0b6813cdb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084296 Oct 02 01:24:46.401995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 907/1820] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:46.979946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:46.980552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:46.990028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:46.990612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:46.991050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:46.991748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:46.992200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:46.993405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:47.055456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:47.063905 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e408840-e8dd-46bb-ae6c-7a5d89e684e4 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.087852 Oct 02 01:24:47.064471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 914/1821] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:46 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:47.424420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:47.425077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:47.431590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:47.432069 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:47.432505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:47.433201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:47.433653 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:47.434161 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:47.500043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:47.508175 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-0cd10c61-e117-4553-8f35-053733eafba7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.088308 Oct 02 01:24:47.508739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 908/1822] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:48.086993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:48.087650 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:48.094084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:48.094585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:48.095030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:48.095726 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:48.096189 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:48.096619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:48.158748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:48.166385 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-148587a9-fa40-4611-87a2-4c42d2b6b07a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083293 Oct 02 01:24:48.166944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 915/1823] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:48 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:48.530420 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:48.531040 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:48.533368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=56 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:48.538781 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:48.539260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:48.539695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:48.540386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:48.540845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:48.541272 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:48.600451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:48.609026 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-89742d0c-f997-42e2-a9a1-5a0ef3a33b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082486 Oct 02 01:24:48.609595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 909/1824] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:49.188749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:49.189360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:49.195751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:49.196227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:49.196659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:49.197343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:49.197794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:49.198246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:49.258266 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:49.266338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-658856e9-2a03-4a26-bc24-0ff4be9de24b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081403 Oct 02 01:24:49.266896 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 916/1825] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:49 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:49.632282 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:49.632899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:49.639935 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:49.640414 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:49.640854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:49.641576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:49.642029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:49.642485 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:49.706973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:49.718205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4294aa2f-a0de-4265-a5e1-2a258f616718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.089744 Oct 02 01:24:49.718778 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 910/1826] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:50.289349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:50.289888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:50.292202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=56 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:24:50.298016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:50.298514 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:50.298943 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:50.299620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:50.300066 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:50.300484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:50.359756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:50.367670 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24ddb0b1-aaaf-4af3-93b4-8339ebaa6140 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082264 Oct 02 01:24:50.368225 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 917/1827] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:50 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:50.741307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:50.741934 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:50.748448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:50.748928 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:50.749369 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:50.750091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:50.750540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:50.750967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:50.809851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:50.818025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c4077407-4e35-4609-bd52-6bdbfc8b86b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080589 Oct 02 01:24:50.818618 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 911/1828] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:51.390506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:51.391023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:51.397399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:51.397872 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:51.398336 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:51.399019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:51.399466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:51.399888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:51.458936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:51.466573 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2edc0a19-3ddc-420d-bb36-8a7c194061ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080035 Oct 02 01:24:51.467126 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 918/1829] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:51 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:51.840957 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:51.842089 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:51.848728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:51.849212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:51.849652 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:51.850392 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:51.850845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:51.851268 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:51.913515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:51.922295 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-98e62c8d-f8b6-4c5c-919c-a1d571dba946 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085218 Oct 02 01:24:51.922861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 912/1830] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:52.489195 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:52.489803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:52.496260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:52.497044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:52.498346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:52.499567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:52.500356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:52.501133 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:52.561203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:52.568738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44bdd605-dfaa-4ce9-83a6-8766472714ca tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083654 Oct 02 01:24:52.569294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 919/1831] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:52 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:52.944621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:52.945237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:52.951633 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:52.952112 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:52.952556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:52.953242 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:52.953693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:52.954142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:53.013336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:53.021500 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7b9d2926-2520-41e2-bac1-d6c05aaa5782 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080732 Oct 02 01:24:53.022087 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 913/1832] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:53.592841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:53.593383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:53.599903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:53.600370 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:53.600803 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:53.601493 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:53.601936 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:53.602380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:53.661411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:53.668842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98018a17-4043-493a-b36b-4d6c981e3777 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080545 Oct 02 01:24:53.669395 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 920/1833] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:53 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:54.044074 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:54.044719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:54.051205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.051686 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.052126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.052817 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.053267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.053690 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.116377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:54.125149 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c7559d96-2c5f-4b0a-bd66-b5be1d970c17 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085039 Oct 02 01:24:54.125716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 914/1834] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:54.691774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:54.692338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:54.698859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.699330 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.699760 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.700451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:54.700906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:54.701325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:54.763399 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:54.771031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-995863e4-0ace-4750-9a46-3e11f87efcd8 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083153 Oct 02 01:24:54.771593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 921/1835] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:54 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:55.147722 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:55.148368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:55.155396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.155870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.156302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.156987 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.157440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.157865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.218477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:55.226472 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6b4bef4e-d2d0-4996-a5b4-ae7aa9ba0fad tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082587 Oct 02 01:24:55.227044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 915/1836] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:55.793792 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:55.794450 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:55.800834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.801313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.801749 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.802469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:55.802924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:55.803349 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:55.862734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:55.870325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e02bb436-6c2f-4879-903e-ec7caa4ca61b tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080416 Oct 02 01:24:55.870882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 922/1837] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:55 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:56.248761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:56.249370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:56.255706 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:56.256179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:56.256613 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:56.257296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:56.257744 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:56.258221 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:56.321098 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:56.329271 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d1f7be65-530c-403c-b33e-9a1771a4eb6b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084453 Oct 02 01:24:56.329840 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 916/1838] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:56.893248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:56.893862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:56.900368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:56.900848 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:56.901290 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:56.901978 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:56.902466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:56.902890 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:56.964108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:56.972487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79a29183-8dd0-4d8e-b2a3-5febe5530c85 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083135 Oct 02 01:24:56.973051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 923/1839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:56 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:57.352049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:57.352666 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:57.359478 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:57.360206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:57.360637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:57.361321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:57.361768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:57.362225 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:57.421864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:57.429978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-89cbec0b-b640-4088-8d1a-496f371b3343 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081725 Oct 02 01:24:57.430577 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 917/1840] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:57.995823 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:57.996431 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:58.002915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.003393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.003827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.004505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.004952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.005371 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.065128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:58.072885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b16392ef-3e9c-4eff-82b7-992a04ed92c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080926 Oct 02 01:24:58.073450 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 924/1841] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:57 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:58.453319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:58.453844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:58.460222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.460695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.461122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.461803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:58.462276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:58.462704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:58.525283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:58.533379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-00d65fb3-714d-4e08-9eb8-65c636ebe075 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084488 Oct 02 01:24:58.533956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 918/1842] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:59.095255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:59.095903 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:59.102360 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:59.102842 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:59.103279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:59.103967 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:59.104421 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:59.104845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:59.164247 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:59.172243 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dad9893e-5919-424b-9a2c-4e21443d1e63 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080841 Oct 02 01:24:59.172799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 925/1843] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:59 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:24:59.555687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:24:59.556304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:24:59.562727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:59.564036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:59.564036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:59.564443 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:24:59.565003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:24:59.565549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:24:59.628063 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:24:59.636302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-de01ab55-bde1-4152-975d-33df56825692 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084515 Oct 02 01:24:59.636876 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 919/1844] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:24:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:00.195324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:00.195960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:00.202883 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:00.203356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:00.203783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:00.204483 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:00.204926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:00.205342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:00.264715 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:00.272342 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3b3ef83-79be-4f61-b6ea-b13647650244 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080848 Oct 02 01:25:00.272907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 926/1845] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:00 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:00.658556 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:00.659207 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:00.665641 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:00.666158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:00.666604 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:00.667300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:00.667756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:00.668182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:00.671199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:00.731077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:00.740110 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d19e0009-8b8d-41d4-82a0-0ace7b095145 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085444 Oct 02 01:25:00.740673 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 920/1846] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:01.294809 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:01.295347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:01.301727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.302242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.302682 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.303372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.303826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.304255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.364219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:01.371770 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-346b21fb-201b-4f9d-94a6-8e3203590b0e tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080920 Oct 02 01:25:01.372329 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 927/1847] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:01 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:01.762663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:01.763829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:01.773154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.773154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.773154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.773154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:01.774108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:01.774108 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:01.832348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:01.840578 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f43365ae-184f-4923-8341-ad0ac4e3566a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081733 Oct 02 01:25:01.841191 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 921/1848] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:02.394474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:02.395039 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:02.401447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:02.401924 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:02.402388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:02.403078 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:02.404028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:02.404451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:02.406990 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:02.468413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:02.476338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08851bb9-c909-4416-a34c-c9d6a26d309a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.085836 Oct 02 01:25:02.477098 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 928/1849] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:02 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:02.862924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:02.863539 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:02.869925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:02.870463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:02.870901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:02.871585 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:02.872037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:02.872459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:02.934036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:02.942239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7af15402-b062-4349-8cad-d52d9379e396 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083459 Oct 02 01:25:02.942805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 922/1850] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:03.500985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:03.501629 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:03.508055 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:03.508528 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:03.508954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:03.509637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:03.510108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:03.510533 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:03.569859 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:03.577416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3713f230-9f94-4eee-a7bb-3cf829f219ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080988 Oct 02 01:25:03.577973 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 929/1851] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:03 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:03.964753 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:03.965286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:03.972238 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:03.972714 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:03.973147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:03.973842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:03.974321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:03.974743 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.034198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:04.042309 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e851dc2c-33bd-4660-8e88-e1b190e5fdb7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081437 Oct 02 01:25:04.042882 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 923/1852] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:04.603781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:04.604393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:04.611138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.611620 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.612052 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.612742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:04.613193 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:04.613686 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:04.672754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:04.680267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4020affa-9a45-4a2b-bdce-94a89162cca5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080466 Oct 02 01:25:04.680829 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 930/1853] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:04 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:05.066016 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:05.066682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:05.073058 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:05.073535 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:05.073974 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:05.074687 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:05.075171 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:05.075597 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:05.137194 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:05.145290 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5df48f46-83a2-4a48-9fab-b8c70f5b4718 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083272 Oct 02 01:25:05.145848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 924/1854] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:05.703727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:05.704339 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:05.710920 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:05.711397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:05.711834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:05.712526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:05.712980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:05.713405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:05.772767 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:05.780890 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-25ec56ad-9c6c-4c17-b6b4-651785d604bd tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081533 Oct 02 01:25:05.781445 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 931/1855] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:05 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:06.167774 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:06.168385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:06.174761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.175234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.175665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.176348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.176793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.177222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.237507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:06.248296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6b4006b3-13bf-495b-b701-c7ce0f43ae9b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084291 Oct 02 01:25:06.248909 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 925/1856] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:06.803565 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:06.804175 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:06.810659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.811139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.811570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.812287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:06.812743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:06.813170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:06.872356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:06.880010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ccedf1c-3555-4958-a95e-ce03cfc903c1 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080339 Oct 02 01:25:06.880569 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 932/1857] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:06 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:07.270573 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:07.271195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:07.277620 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:07.278756 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:07.279198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:07.279899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:07.280357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:07.280785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:07.343227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:07.351455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-29f11821-ba1d-436a-babc-d45c7128e5d5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084754 Oct 02 01:25:07.352034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 926/1858] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:07.902512 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:07.903154 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:07.909621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:07.910134 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:07.910577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:07.911285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:07.911727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:07.912148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:07.972622 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:07.980305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c102045-d567-465d-9fce-bef3e9aad4fa tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081702 Oct 02 01:25:07.980876 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 933/1859] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:07 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:08.374234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:08.374855 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:08.381296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.381779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.382248 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.382945 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:08.383402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:08.383836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:08.442612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:08.451188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d6470271-4c57-4e2f-9574-2756166a6071 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080899 Oct 02 01:25:08.451762 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 927/1860] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:08 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:09.003694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:09.004304 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:09.010757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.011260 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.011693 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.013021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.013476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.013893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.075810 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:09.083391 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b10a198-f47f-4c2c-b847-90ff3459c2f2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083541 Oct 02 01:25:09.083956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 934/1861] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:08 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:09.475474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:09.476143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:09.483284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.483986 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.484955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.485451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:09.486166 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:09.486649 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:09.551586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:09.560778 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4f3fa0f1-5377-47ca-bf23-80212bf621f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.090486 Oct 02 01:25:09.561438 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 928/1862] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:10.105466 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:10.106137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:10.112801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:10.113275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:10.113706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:10.114424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:10.114874 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:10.115291 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:10.173852 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:10.181444 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-88ce4f08-02eb-415a-941b-43f21f2bbc5f tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.079812 Oct 02 01:25:10.182003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 935/1863] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:10 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:10.583196 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:10.583875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:10.590367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:10.590848 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:10.591287 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:10.591977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:10.592433 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:10.592860 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:10.652245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:10.660367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6eb75498-f234-472d-ab1b-34e2f7a224d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081073 Oct 02 01:25:10.660941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 929/1864] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:11.204212 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:11.204821 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:11.211222 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:11.211701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:11.212135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:11.212826 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:11.213279 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:11.213704 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:11.273728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:11.281338 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-758eeb80-fe02-4b58-a0b6-cf922268ced6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081477 Oct 02 01:25:11.281902 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 936/1865] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:11 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:11.682507 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:11.683078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:11.690304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:11.690788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:11.691227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:11.691914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:11.692369 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:11.692793 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:11.754031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:11.762093 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2419eb73-25a3-4afa-97f6-7c684e65af03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083468 Oct 02 01:25:11.762732 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 930/1866] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:12.304170 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:12.304738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:12.310762 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.311242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.311678 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.312366 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.312819 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.313241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.372176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:12.379811 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0da96169-d4bd-4b02-a71d-2afa4516a235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.079749 Oct 02 01:25:12.380374 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 937/1867] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:12 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:12.784586 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:12.785195 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:12.791434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.791910 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.792342 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.793019 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:12.793469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:12.793924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:12.853032 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:12.861243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-aacd34c3-cbf0-4e99-81f9-99841b3b2dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080463 Oct 02 01:25:12.861782 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 931/1868] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:13.403002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:13.403558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:13.409951 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.410477 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.410913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.411627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.412084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.412507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.471980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:13.479647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5d3e965-e002-48fc-b318-1ad40c1643a5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080550 Oct 02 01:25:13.480202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 938/1869] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:13 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:13.884246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:13.884865 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:13.891897 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.892376 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.892815 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.893503 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:13.893955 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:13.894404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:13.958387 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:13.967275 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-20f89a3d-e0ae-437a-bf16-3346f5f8693a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.086896 Oct 02 01:25:13.967842 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 932/1870] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:14.503252 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:14.503865 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:14.510310 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:14.510794 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:14.511231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:14.511926 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:14.513013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:14.513424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:14.573333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:14.581860 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6857e0e3-405d-4554-b995-115d1a2084ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082446 Oct 02 01:25:14.582474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 939/1871] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:14 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:14.989131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:14.989779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:14.996337 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:14.996826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:14.997264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:14.997952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:14.998431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:14.998856 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.058184 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:15.066452 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1b6c2cdc-424d-4abc-aa4e-a1c46d2932b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081190 Oct 02 01:25:15.067017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 933/1872] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:15.605018 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:15.605664 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:15.612451 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.612934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.613372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.614084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:15.614537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:15.614965 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:15.674200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:15.681875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c9f1438-8235-4f13-91d9-c4e2176f2652 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080737 Oct 02 01:25:15.682478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 940/1873] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:15 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:16.088689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:16.089306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:16.095771 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:16.096251 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:16.096689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:16.097375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:16.097825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:16.098294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:16.159521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:16.167609 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-172724cb-8ae7-4490-99df-d02972a293f7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082763 Oct 02 01:25:16.168168 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 934/1874] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:16.704203 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:16.704814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:16.711413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:16.711888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:16.712317 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:16.713000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:16.713449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:16.713868 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:16.775044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:16.783004 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ae778d4-c9ce-4cca-aa56-5ddf06121e70 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082705 Oct 02 01:25:16.783565 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 941/1875] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:16 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:17.191049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:17.191657 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:17.198027 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:17.198531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:17.198962 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:17.200145 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:17.200594 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:17.201014 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:17.260956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:17.269614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7d92aff0-2ef8-48da-ab9a-f6800ca98fd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082396 Oct 02 01:25:17.270204 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 935/1876] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:17.806361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:17.806975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:17.814106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:17.814592 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:17.815030 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:17.815721 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:17.816208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:17.816733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:17.877220 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:17.885082 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e0d06f7-78c2-4a36-b335-8e88d47cd09a tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082728 Oct 02 01:25:17.885649 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 942/1877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:17 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:18.291648 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:18.292264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:18.299309 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:18.299781 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:18.300206 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:18.300887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:18.301331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:18.301749 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:18.363144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:18.365317 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:18.372668 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c38fecf6-326c-4c10-ae2b-adcb9e753fd5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084904 Oct 02 01:25:18.373236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 936/1878] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:18.907619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:18.908230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:18.914637 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:18.915110 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:18.915536 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:18.916213 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:18.916659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:18.917076 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:18.976724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:18.984418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3eb1fca-a153-430d-9ead-a79384baf06c tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080692 Oct 02 01:25:18.985231 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 943/1879] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:18 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:19.395447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:19.396066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:19.398388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=56 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:19.403637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:19.404147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:19.404583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:19.405274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:19.405730 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:19.406182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:19.467355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:19.475449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-43fb55fc-93fe-4eed-a927-a27097e61c1c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083858 Oct 02 01:25:19.476012 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 937/1880] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:20.007801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:20.008393 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:20.015542 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:20.016017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:20.016447 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:20.017132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:20.017579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:20.018031 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:20.078028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:20.080220 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:20.086658 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ca36604e-d330-4804-b1c4-5d4bcc8e1235 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082720 Oct 02 01:25:20.087223 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 944/1881] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:20 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:20.499006 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:20.499624 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:20.506009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:20.506512 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:20.506949 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:20.507635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:20.508088 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:20.508510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:20.569571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:20.578264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-47ef3a5f-e94d-4add-9ea2-29f570f2295f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083591 Oct 02 01:25:20.578829 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 938/1882] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:21.110775 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:21.111411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:21.113880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=56 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:21.119087 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:21.119567 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:21.120002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:21.120689 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:21.121139 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:21.121563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:21.180801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:21.188540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92f6be7b-ae49-4ffb-99bf-2ad194b26d66 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081877 Oct 02 01:25:21.189106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 945/1883] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:21 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:21.600635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:21.601267 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:21.607658 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:21.608130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:21.608557 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:21.609235 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:21.609930 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:21.610370 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:21.669228 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:21.677297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cba95075-1c14-466e-812a-3a869c5c595e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080549 Oct 02 01:25:21.677858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 939/1884] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:22.211010 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:22.211645 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:22.218116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:22.218604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:22.219047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:22.219743 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:22.220202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:22.220633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:22.280614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:22.288313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-519afa8a-438e-45cb-b1f9-f214f3e487d5 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081144 Oct 02 01:25:22.288817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 946/1885] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:22 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:22.698719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:22.699355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:22.705777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:22.706288 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:22.706719 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:22.707404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:22.707852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:22.708273 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:22.770643 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:22.779334 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-deeb2f20-d3c1-491a-9ee6-76a5ea86b98c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084500 Oct 02 01:25:22.779884 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 940/1886] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:23.312137 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:23.312684 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:23.319108 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:23.319588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:23.320021 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:23.320705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:23.321158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:23.321581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:23.381114 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:23.389325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-96cd52a1-d80b-4851-be62-ec6170c14785 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081665 Oct 02 01:25:23.389880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 947/1887] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:23 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:23.802303 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:23.802923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:23.810115 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:23.810601 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:23.811038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:23.811727 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:23.812181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:23.812603 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:23.875347 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:23.883612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-50e9efe1-22ed-4a70-b610-2b8b15566937 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085193 Oct 02 01:25:23.884188 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 941/1888] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:24.411915 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:24.412523 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:24.418937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:24.419407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:24.419860 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:24.420537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:24.420985 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:24.421404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:24.482187 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:24.489981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6fe215c-7447-4063-b569-867f13ac5eac tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081985 Oct 02 01:25:24.490632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 948/1889] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:24 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:24.905871 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:24.906577 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:24.912932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:24.913416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:24.913849 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:24.914567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:24.915017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:24.915439 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:24.976896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:24.985262 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-52d34242-b229-47d0-a62c-ad241f1bc86e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083237 Oct 02 01:25:24.985823 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 942/1890] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:25.512478 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:25.513013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:25.519436 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:25.519921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:25.520378 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:25.521057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:25.521531 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:25.521950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:25.581306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:25.588871 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fa5a060-7c85-461a-8e84-c301ce3317d6 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080313 Oct 02 01:25:25.589429 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 949/1891] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:25 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:26.008081 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:26.008698 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:26.015779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:26.016256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:26.016693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:26.017380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:26.017835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:26.018291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:26.080127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:26.088095 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-efbe3cf3-d0bc-44e4-864c-321464b2672a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083828 Oct 02 01:25:26.088663 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 943/1892] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:26.612364 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:26.612952 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:26.619417 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:26.619887 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:26.620316 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:26.621695 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:26.622181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:26.622599 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:26.680800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:26.688988 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-755c4458-dd88-4a86-9608-5451558b0938 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080801 Oct 02 01:25:26.689548 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 950/1893] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:26 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:27.111844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:27.112463 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:27.118988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:27.119469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:27.119905 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:27.120634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:27.121143 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:27.121571 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:27.183306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:27.191579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f30e89f3-f578-4ff8-bc8c-09d1ca00ed63 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083902 Oct 02 01:25:27.192147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 944/1894] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:27.712179 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:27.712851 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:27.719956 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:27.720432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:27.720861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:27.721544 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:27.721994 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:27.722441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:27.781734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:27.789461 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-45fc97da-1860-49d1-8d49-2889745b09ae tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081115 Oct 02 01:25:27.790022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 951/1895] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:27 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:28.213279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:28.213927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:28.220491 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:28.220999 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:28.221431 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:28.222142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:28.222602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:28.223034 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:28.281917 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:28.289959 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ff3286ef-490f-42d4-a0c0-0bdb22687b66 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080620 Oct 02 01:25:28.290559 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 945/1896] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:28.811325 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:28.811999 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:28.818450 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:28.818930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:28.819363 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:28.820052 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:28.820505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:28.820931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:28.880484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:28.888652 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-69d19fd0-a6d6-4cf7-aa56-c4b2cf3f6bda tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081290 Oct 02 01:25:28.889208 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 952/1897] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:28 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:29.312310 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:29.312948 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:29.319455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:29.319925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:29.320355 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:29.321036 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:29.321482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:29.321899 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:29.384028 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:29.392710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-799f082e-6a3d-4d01-9e0d-5e0223ca33c2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084729 Oct 02 01:25:29.393276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 946/1898] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:29.911888 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:29.912432 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:29.919411 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:29.919895 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:29.920333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:29.921028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:29.921484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:29.921912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:29.981996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:29.989875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f15b19a6-6f50-4800-ae3c-27a6d9c47cf3 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081981 Oct 02 01:25:29.990476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 953/1899] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:29 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:30.414995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:30.415613 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:30.421973 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:30.422489 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:30.422925 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:30.423623 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:30.424077 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:30.424504 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:30.483567 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:30.492122 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-095c9589-61b1-43e1-8d9f-a81cb99bd2a4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080922 Oct 02 01:25:30.492704 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 947/1900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:31.013089 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:31.013707 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:31.020183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:31.020663 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:31.021105 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:31.021799 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:31.022285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:31.022716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:31.085236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:31.092934 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cda5c299-8b07-4304-aaa8-f5c12d3bda65 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084324 Oct 02 01:25:31.093504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 954/1901] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:31 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:31.514247 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:31.514864 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:31.521336 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:31.521812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:31.522285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:31.522972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:31.523422 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:31.523876 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:31.585324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:31.593905 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-20f8bc98-6a7a-4073-a169-1f32580de0cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083605 Oct 02 01:25:31.594510 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 948/1902] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:32.116345 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:32.116948 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:32.123362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:32.123835 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:32.124265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:32.124946 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:32.125394 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:32.125814 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:32.184627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:32.192168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b658cb26-c3b1-4a35-a529-34c889bffb13 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.079754 Oct 02 01:25:32.192724 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 955/1903] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:32 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:32.616819 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:32.617440 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:32.624607 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:32.625083 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:32.625515 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:32.626234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:32.626682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:32.627104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:32.770851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:32.779017 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-5634a452-659d-46d0-8e13-dc63d2945373 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.165996 Oct 02 01:25:32.779576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 949/1904] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:33.215124 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:33.216248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:33.222647 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:33.223123 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:33.223553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:33.224398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:33.224850 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:33.225267 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:33.285129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:33.292740 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a5422c6-81e2-44ad-a79f-0c713d3ad1e2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.081471 Oct 02 01:25:33.293240 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 956/1905] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:33 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:33.800749 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:33.801361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:33.807886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:33.808398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:33.808835 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:33.810024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:33.810520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:33.810954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:33.873635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:33.881711 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b20454e6-ac1f-47aa-8e82-45dd46fcce76 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084878 Oct 02 01:25:33.882319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 950/1906] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:34.315621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:34.316227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:34.322612 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:34.323084 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:34.323510 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:34.324191 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:34.324640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:34.325564 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:34.384583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:34.392751 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a542cd21-c513-400f-825a-c096403ec2e0 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080988 Oct 02 01:25:34.393305 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 957/1907] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:34 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:34.906038 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:34.906675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:34.913014 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:34.913490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:34.913922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:34.914640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:34.915091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:34.915524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:34.974226 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:34.982844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3a17f5cc-0877-4c45-a1ae-252c582f582a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080791 Oct 02 01:25:34.983407 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 951/1908] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:35.416659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:35.417219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:35.425117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:35.425604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:35.426043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:35.426781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:35.427230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:35.427654 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:35.488558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:35.496576 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b912896-34cc-4baf-8841-0081fac02452 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.083884 Oct 02 01:25:35.497140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 958/1909] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:35 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:36.005980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:36.006627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:36.013799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:36.014302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:36.014731 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:36.015419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:36.015866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:36.016285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:36.078941 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:36.087307 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3d1dbe2a-11f9-467e-a04e-9ffb6859d53a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085176 Oct 02 01:25:36.087872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 952/1910] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:36.518616 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:36.519233 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:36.525717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:36.526242 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:36.526688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:36.527377 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:36.527831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:36.528254 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:36.587641 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:36.595204 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3000bba0-2f37-4a66-88b0-bf1dfddf0492 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080466 Oct 02 01:25:36.595770 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 959/1911] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:36 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:37.109866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:37.110506 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:37.116814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:37.117283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:37.117709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:37.118416 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:37.118861 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:37.119278 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:37.133689 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=100 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:37.180517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:37.188575 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-06005292-24d6-4b22-9293-50b12b52bb5e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082838 Oct 02 01:25:37.189151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 953/1912] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:37.618456 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:37.619070 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:37.626093 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:37.626570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:37.627003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:37.627696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:37.628149 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:37.628570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:37.687357 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:37.694970 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c9c5ea4-1b8b-4b48-bba6-8cdf430a124d tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080385 Oct 02 01:25:37.695527 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 960/1913] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:37 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:38.211506 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:38.212114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:38.219204 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:38.219683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:38.220111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:38.220811 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:38.221239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:38.221660 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:38.284207 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:38.293383 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cb01c8cc-3e7e-41f6-bce1-eb8d6bf0686f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085624 Oct 02 01:25:38.294570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 954/1914] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:38 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:38.718801 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:38.719438 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:38.725849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:38.726362 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:38.726791 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:38.727476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:38.727922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:38.728344 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:38.745042 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:38.790286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:38.798701 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65c5a438-1072-4701-9c64-be7ff3a8be36 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.084523 Oct 02 01:25:38.799259 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 961/1915] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:38 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:39.316736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:39.317333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:39.324256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:39.324726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:39.325153 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:39.325836 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:39.326305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:39.326900 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:39.387914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:39.396049 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-41e9b733-c88a-425e-a06e-db1710274528 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083359 Oct 02 01:25:39.396609 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 955/1916] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:39.820939 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:39.821583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:39.828051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:39.828532 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:39.828968 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:39.829659 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:39.830132 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:39.830558 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:39.892022 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:39.899600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-782719d8-33ae-4fe2-8d24-fdf24047d128 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.082728 Oct 02 01:25:39.900160 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 962/1917] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:39 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:40.418977 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:40.419588 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:40.425923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:40.426434 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:40.426866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:40.427550 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:40.427995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:40.428415 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:40.490333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:40.498490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-841a5892-d2d8-4d77-bfe1-86373b5b8634 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083763 Oct 02 01:25:40.498992 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 956/1918] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:40.922581 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:40.923117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 20234809-0f73-4a21-a8ab-08a7715c83fd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:40.929487 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:40.929977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:40.930453 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:40.931143 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:40.931593 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:40.932043 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:40.991383 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5f91289c403cb49f428e53431591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c596a2d0f430d987352a616666610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:40.999470 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9069296d-f5bf-4bd4-8602-caeee472a6ce tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd" status: 200 len: 1226 microversion: 2.1 time: 0.080860 Oct 02 01:25:41.000038 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 963/1919] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:40 2022] GET /compute/v2.1/servers/20234809-0f73-4a21-a8ab-08a7715c83fd => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:41.446729 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:41.447243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:41.454268 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.454692 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.455123 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.455807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.456256 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.456678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.469893 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.wsgi [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] HTTP exception thrown: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Request method failure captured: Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: request: DELETE /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae HTTP/1.1 Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept: application/json Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Accept-Encoding: identity Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Connection: close Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Length: 0 Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Content-Type: application/json Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Host: 10.222.0.25 Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Openstack-System-Scope: None Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: User-Agent: python-urllib3/1.26.12 Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Auth-Token: gAAAAABjOOM5wDBJWcvhfFabEBI23QcSvQcYL_1Zm5LPORD83k4M4YoavqBp8wQgEaD-ms4c3WQNBjjcRC7ArFwVHXD3ftgQFzyDEf-KYyhyXUkkk34114Gf2zmX2BKpPZli0YVJNaw4SojV4b1BWjyyRsJwiPuQTyYxw0oleUmwFwm6dphUzFs Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Id: None Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Domain-Name: None Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Identity-Status: Confirmed Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Is-Admin-Project: True Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Id: default Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Domain-Name: Default Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Id: 017c596a2d0f430d987352a616666610 Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Project-Name: tempest-TestVolumeBootPattern-747325683 Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Role: member,reader Oct 02 01:25:41.471590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Roles: member,reader Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/017c596a2d0f430d987352a616666610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/017c596a2d0f430d987352a616666610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_017c596a2d0f430d987352a616666610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/017c596a2d0f430d987352a616666610"}]}] Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant: tempest-TestVolumeBootPattern-747325683 Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Id: 017c596a2d0f430d987352a616666610 Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-Tenant-Name: tempest-TestVolumeBootPattern-747325683 Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User: tempest-TestVolumeBootPattern-747325683-project Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Id: default Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Domain-Name: Default Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Id: a94a5f91289c403cb49f428e53431591 Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: X-User-Name: tempest-TestVolumeBootPattern-747325683-project Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: method: > Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: exception: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.473476 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: action_args: {'id': '46c321dc-02fa-4499-b40f-35a4d2409bae'} Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:25:41.474590 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.476445 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.478279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Returning 404 to user: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. {{(pid=120424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:25:41.478279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-768b5c8e-6949-4233-90fa-8b0b7862ffc2 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 404 len: 111 microversion: 2.1 time: 0.030138 Oct 02 01:25:41.478279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 957/1920] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Oct 2 01:25:41 2022] DELETE /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:25:41.481369 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:41.481959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] [instance: 46c321dc-02fa-4499-b40f-35a4d2409bae] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:41.488141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.488621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.489057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.489747 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.490230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.490661 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.504063 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] HTTP exception thrown: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Request method failure captured: Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae HTTP/1.1 Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept: application/json Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Accept-Encoding: identity Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Connection: close Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Length: 0 Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Content-Type: application/json Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Host: 10.222.0.25 Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjOOM5wDBJWcvhfFabEBI23QcSvQcYL_1Zm5LPORD83k4M4YoavqBp8wQgEaD-ms4c3WQNBjjcRC7ArFwVHXD3ftgQFzyDEf-KYyhyXUkkk34114Gf2zmX2BKpPZli0YVJNaw4SojV4b1BWjyyRsJwiPuQTyYxw0oleUmwFwm6dphUzFs Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Id: None Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Domain-Name: None Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Id: 017c596a2d0f430d987352a616666610 Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-747325683 Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Role: member,reader Oct 02 01:25:41.505676 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Roles: member,reader Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/017c596a2d0f430d987352a616666610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/017c596a2d0f430d987352a616666610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_017c596a2d0f430d987352a616666610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/017c596a2d0f430d987352a616666610"}]}] Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-747325683 Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Id: 017c596a2d0f430d987352a616666610 Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-747325683 Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-747325683-project Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Id: a94a5f91289c403cb49f428e53431591 Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-747325683-project Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: method: > Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: exception: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.507484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: action_args: {'id': '46c321dc-02fa-4499-b40f-35a4d2409bae'} Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 02 01:25:41.508380 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. Oct 02 01:25:41.509796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 02 01:25:41.511099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Returning 404 to user: Instance 46c321dc-02fa-4499-b40f-35a4d2409bae could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 02 01:25:41.511099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0d5aa0e-d4ce-456c-8026-2aa765377006 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae" status: 404 len: 111 microversion: 2.1 time: 0.029625 Oct 02 01:25:41.511099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 964/1921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:41 2022] GET /compute/v2.1/servers/46c321dc-02fa-4499-b40f-35a4d2409bae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 02 01:25:41.520527 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:41.521139 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:41.527044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.527520 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.528004 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.528683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:41.529129 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:41.529547 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:41.588142 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:41.596286 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-45155acb-91ea-43be-89c2-5c3b72cc8915 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.079543 Oct 02 01:25:41.596862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 958/1922] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:42.618694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:42.619313 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:42.625322 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:42.625836 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:42.626308 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:42.627000 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:42.627455 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:42.627880 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:42.689867 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:42.698044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-efd1fd3f-5a7f-4345-81b6-72a928e76d93 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083205 Oct 02 01:25:42.698628 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 965/1923] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:43.721499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:43.722183 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:43.728066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:43.728537 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:43.728965 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:43.729647 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:43.730114 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:43.730538 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:43.795277 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:43.803329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-13116a22-b3a0-4995-9025-abc2e8c2cbee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085814 Oct 02 01:25:43.803887 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 959/1924] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:44.824928 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:44.825538 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:44.831945 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:44.832419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:44.832849 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:44.833535 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:44.833980 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:44.834425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:44.895164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:44.903265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-730c7416-3116-40bd-8a62-11c17c6e0248 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082148 Oct 02 01:25:44.903822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 966/1925] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:45.926636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:45.927190 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:45.935375 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:45.935896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:45.936335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:45.937029 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:45.937493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:45.937946 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:45.998181 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:46.006367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-a2f874c8-4075-40ae-9b6b-d843b22b0adb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083633 Oct 02 01:25:46.006932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 960/1926] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:47.029981 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:47.030640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:47.037183 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:47.037662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:47.038119 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:47.038817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:47.039324 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:47.039750 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:47.101199 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:47.109610 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1dde7f92-2a8c-4e38-a42f-5bb0b081b80d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083856 Oct 02 01:25:47.110198 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 967/1927] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:48.132291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:48.132809 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:48.139405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.139885 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.140325 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:48.141022 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:48.141477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:48.141902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:48.201365 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:48.209534 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1ef66d28-d727-485f-baa2-606e6c5aeb3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081190 Oct 02 01:25:48.210128 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 961/1928] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:25:49.232931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:49.233543 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:49.240346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:49.240816 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:49.241247 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:49.241944 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:49.242419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:49.242840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:49.303165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:49.311866 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d3a717f-1de6-4193-b2a8-1105c91b6fc4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083338 Oct 02 01:25:49.312420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 968/1929] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:49 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:50.334357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:50.334916 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:50.337210 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=50 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:50.342447 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:50.342963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:50.343407 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:50.344111 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:50.344564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:50.344989 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:50.407635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:50.415796 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-92ca0078-e83f-43c4-98c8-da85d7fbc8eb tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085425 Oct 02 01:25:50.416359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 962/1930] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:51.438009 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:51.438580 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:51.440930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=48 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:25:51.446147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:51.446625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:51.447051 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:51.447733 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:51.448180 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:51.448600 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:51.510618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:51.519176 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9f1b681-881a-429e-b2cc-a372f014021c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085070 Oct 02 01:25:51.519734 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 969/1931] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:52.542404 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:52.543644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:52.550079 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:52.550568 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:52.551003 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:52.551693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:52.552146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:52.552569 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:52.614406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:52.620101 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ebd00cff-b99c-4b68-834f-f957b92b1d55 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081547 Oct 02 01:25:52.620665 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 963/1932] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:53.641621 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:53.642255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:53.648633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:53.649104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:53.649530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:53.650248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:53.650698 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:53.651116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:53.711646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:53.719683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf4dfdd8-c53a-467e-9f5f-5b0b8200cf81 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081891 Oct 02 01:25:53.720241 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 970/1933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:54.742768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:54.743366 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:54.749703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:54.750205 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:54.750640 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:54.751324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:54.751768 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:54.752182 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:54.811078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:54.819315 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-ac3c4eae-1e08-4e65-9661-2a7b5f9efcc0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080379 Oct 02 01:25:54.819875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 964/1934] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:55.841546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:55.842140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:55.848667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:55.849141 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:55.849572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:55.850288 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:55.850742 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:55.851166 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:55.912167 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:55.920736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98f2b036-6f9f-4626-96de-ffa1ae71f47d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083149 Oct 02 01:25:55.921293 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 971/1935] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:56.944696 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:56.945321 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:56.952533 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:56.953013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:56.953451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:56.954179 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:56.954637 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:56.955064 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:57.015466 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:57.023606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c7c4f72c-6713-4fb7-a545-ce5d96ea60df tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082794 Oct 02 01:25:57.024176 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 965/1936] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:58.046554 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:58.047164 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:58.053574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:58.054045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:58.054506 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:58.055188 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:58.055634 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:58.056053 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:58.114568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:58.122627 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e2da010-fd86-427f-82b1-27245d328655 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080589 Oct 02 01:25:58.123190 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 972/1937] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:25:59.144787 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:25:59.145398 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:25:59.151975 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:59.152448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:59.152902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:59.153587 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:25:59.154033 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:25:59.154482 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:25:59.213246 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:25:59.221874 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-bfd6bbcc-d2ae-468f-b487-d5fc109c2ac2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080998 Oct 02 01:25:59.222465 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 966/1938] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:25:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:00.244736 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:00.245350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:00.252398 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:00.252875 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:00.253306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:00.253995 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:00.254471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:00.254894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:00.317425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:00.325729 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42037abf-f0a0-4c77-8dfd-1ddbb7980f59 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084917 Oct 02 01:26:00.326334 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 973/1939] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:00 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:01.347703 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:01.348245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:01.354710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:01.355684 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:01.356117 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:01.356797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:01.357244 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:01.357662 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:01.416521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:01.425296 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-674ea9d2-d863-46ac-90cb-a3e1c83632cf tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081522 Oct 02 01:26:01.425857 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 967/1940] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:02.448504 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:02.449674 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:02.456118 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:02.456596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:02.457028 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:02.457719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:02.458200 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:02.458625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:02.517882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:02.526052 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ce7d69d-5410-4e73-9d2f-d29310184084 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081553 Oct 02 01:26:02.526646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 974/1941] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:03.547695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:03.548331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:03.554763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:03.555239 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:03.555669 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:03.556353 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:03.556798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:03.557214 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:03.616160 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:03.624248 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f816a231-0aea-4bfa-b551-bc56a58d62c5 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080397 Oct 02 01:26:03.624805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 968/1942] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:04.647057 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:04.647646 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:04.654685 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:04.655159 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:04.655588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:04.656270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:04.656722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:04.657140 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:04.719265 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:04.727384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-598c6b3a-258a-4243-b3aa-7adaa44e4921 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084231 Oct 02 01:26:04.727927 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 975/1943] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:05.750118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:05.750724 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:05.757024 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:05.757497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:05.757924 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:05.758634 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:05.759082 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:05.759522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:05.818208 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:05.826720 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9bc385d9-187f-449f-b1f7-bd5511935a67 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080462 Oct 02 01:26:05.827279 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 969/1944] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:06.850346 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:06.850950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:06.857959 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:06.858464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:06.859147 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:06.859833 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:06.860278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:06.860695 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:06.922713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:06.930972 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9d770afd-9b3c-4fb9-bb32-496ace443158 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084632 Oct 02 01:26:06.931571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 976/1945] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:07.953967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:07.954572 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:07.961169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:07.961645 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:07.962100 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:07.962790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:07.963237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:07.963655 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:07.966193 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=96 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:08.023236 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:08.031243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-1c620680-c9a5-46c8-8f99-737cca6fc744 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081194 Oct 02 01:26:08.031811 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 970/1946] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:09.054824 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:09.055433 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:09.062388 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:09.062864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:09.063292 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:09.063975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:09.064423 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:09.064840 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:09.067425 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:09.127273 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:09.135306 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f714df14-2759-4cec-8bfc-2103bdb77eba tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084401 Oct 02 01:26:09.135858 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 977/1947] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:10.158902 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:10.159521 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:10.166009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:10.166522 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:10.166963 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:10.167702 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:10.168156 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:10.168589 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:10.227437 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:10.235741 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-f55d4ea5-fbd0-416f-b801-e8ec2cfb337b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080808 Oct 02 01:26:10.236306 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 971/1948] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:11.258182 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:11.258802 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:11.265232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:11.265713 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:11.266178 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:11.266881 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:11.267331 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:11.267754 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:11.328726 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:11.337017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7580df7a-3b0d-4a7f-84c1-d54704819866 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082818 Oct 02 01:26:11.337572 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 978/1949] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:12.360845 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:12.361405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:12.367797 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:12.368283 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:12.368726 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:12.369419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:12.369875 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:12.370984 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:12.429852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:12.438627 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4f26aaa0-f9a5-4a03-899c-597c58bc6ae0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081993 Oct 02 01:26:12.439201 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 972/1950] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:13.461069 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:13.461626 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:13.467642 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:13.468116 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:13.468546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:13.469230 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:13.469683 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:13.470128 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:13.531464 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:13.539574 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c901945e-36e2-4a54-86af-bbdaab47c8ea tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082617 Oct 02 01:26:13.540135 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 979/1951] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:14.560790 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:14.561406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:14.567524 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:14.568005 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:14.568442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:14.569126 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:14.569574 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:14.569997 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:14.630197 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:14.638954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cb44bb6d-71ec-45fe-990a-bd5d8ae236fd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082127 Oct 02 01:26:14.639551 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 973/1952] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:15.661914 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:15.662555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:15.669497 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:15.669976 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:15.670462 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:15.671152 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:15.671606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:15.672029 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:15.733171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:15.741489 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08fa3cff-f607-4a3d-855a-2ec7a26ebcf2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083442 Oct 02 01:26:15.742074 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 980/1953] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:16.763856 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:16.764487 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:16.770927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:16.771409 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:16.771846 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:16.772542 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:16.772995 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:16.773419 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:16.831939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:16.839980 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-3c27fa38-9a70-42aa-b6c9-d797cfe0ab95 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080542 Oct 02 01:26:16.840549 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 974/1954] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:17.863045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:17.863585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:17.869918 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.870418 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.870845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:17.871526 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:17.872002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:17.872420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:18.177757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:18.186845 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-447c6990-5a30-4dd3-a783-d09eceb58673 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.327665 Oct 02 01:26:18.188804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 981/1955] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:19.212053 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:19.212678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:19.219779 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.220264 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.220700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.221396 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:19.221851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:19.222304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:19.281814 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:19.289988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-03eb67a9-f42e-456b-8445-e167c1a3fc0c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081784 Oct 02 01:26:19.290528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 975/1956] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:19 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:20.312579 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:20.313162 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:20.319519 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.319993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.320428 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.321117 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:20.321566 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:20.321987 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:20.382410 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:20.390604 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f1f1a49-e9c1-453a-b964-1f8c46254e73 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081998 Oct 02 01:26:20.391165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 982/1957] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:21.413368 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:21.413923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:21.416304 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=28 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:21.421850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:21.422367 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:21.422799 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:21.423481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:21.423927 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:21.424344 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:21.484763 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:21.492764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d027d8a1-1a2b-422f-ac8c-b5c809633443 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083330 Oct 02 01:26:21.493319 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 976/1958] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:22.516294 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:22.516906 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:22.519468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:26:22.519607 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 (ip 10.222.0.25) !!! Oct 02 01:26:22.520585 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:26:22.520737 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 (ip 10.222.0.25) !!! Oct 02 01:26:22.521577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:26:22.521725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: Sun Oct 2 01:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 (ip 10.222.0.25) !!! Oct 02 01:26:22.522469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=28 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:22.531745 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.532227 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.532662 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.533358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:22.533810 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:22.534263 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:22.598430 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:22.606846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0c159f1-ad84-4596-a7c1-b073346a3d35 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.094378 Oct 02 01:26:22.607414 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 983/1959] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:23.630030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:23.630681 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:23.633091 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:26:23.633222 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:26:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 (ip 10.222.0.25) !!! Oct 02 01:26:23.634209 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:26:23.634324 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:26:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 (ip 10.222.0.25) !!! Oct 02 01:26:23.642761 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.643243 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.643683 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.644380 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:23.644837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:23.645265 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:23.705600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:23.714425 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7eb3e750-8ad8-42bb-9375-6c01c81abb09 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.087654 Oct 02 01:26:23.714985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 977/1960] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:24.736603 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:24.737155 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:24.743825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.744309 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.744756 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.745449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:24.745905 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:24.746384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:24.805479 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:24.813481 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f73162ed-5b34-4278-8128-7b5bdf397f12 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081072 Oct 02 01:26:24.814049 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 984/1961] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:25.835932 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:25.836494 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:25.843528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.844014 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.844451 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:25.845147 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:25.845605 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:25.846030 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:25.904896 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:25.912952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-52d844c5-4a51-4c83-8261-4b0603734b9c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080920 Oct 02 01:26:25.913523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 978/1962] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:26.935278 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:26.936351 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:26.942553 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:26.943037 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:26.943473 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:26.944177 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:26.944631 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:26.945060 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:27.007602 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:27.015725 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-decae3cb-dc72-4932-a255-ddc8217516a7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085068 Oct 02 01:26:27.016285 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 985/1963] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:28.038770 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:28.039379 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:28.046265 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:28.046740 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:28.047168 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:28.047850 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:28.048294 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:28.048710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:28.107570 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:28.115960 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-06a8bf48-e9a2-4838-b814-5026d7cf3dc2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080998 Oct 02 01:26:28.116493 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 979/1964] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:29.142404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:29.143014 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:29.149405 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.149873 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.150333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.151619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:29.152065 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:29.152485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:29.210746 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:29.218885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be34eb93-2815-48cf-8871-5e2a7c956b3d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080440 Oct 02 01:26:29.219445 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 986/1965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:30.241833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:30.242479 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:30.249348 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.249826 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.250300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.250993 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:30.251446 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:30.251866 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:30.310827 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:30.318843 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-75a77b32-b5ef-440d-a96e-6d58b60fa74f tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080901 Oct 02 01:26:30.319408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 980/1966] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:30 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:31.341935 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:31.342557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:31.348953 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.349433 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.349864 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.350582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:31.351032 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:31.351452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:31.413549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:31.421688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57fde028-a5b1-4eff-bb0a-7dbad54212fe tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084398 Oct 02 01:26:31.422277 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 987/1967] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:32.444738 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:32.445270 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:32.451794 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.452276 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.452709 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.453400 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:32.453852 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:32.454298 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:32.513397 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:32.521377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-43a1687c-0311-4ca1-8c6e-c5c0d84d96b9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080569 Oct 02 01:26:32.521937 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 981/1968] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:33.544347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:33.544898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:33.551496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:33.551974 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:33.552407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:33.553099 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:33.553552 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:33.553975 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:33.615778 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:33.623763 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad85c2ea-a771-4853-9a73-d5a2e95279b0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083371 Oct 02 01:26:33.624326 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 988/1969] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:33 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:34.646602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:34.647212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:34.653528 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.654001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.654459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.655140 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:34.655581 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:34.655998 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:34.715299 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:34.723350 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-180b5635-bf55-4357-bd54-b32e8a66a9b1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080593 Oct 02 01:26:34.723922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 982/1970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:34 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:35.746120 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:35.746717 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:35.753012 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.753484 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.753912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.754619 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:35.755067 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:35.755486 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:35.816930 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:35.825785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccebca47-5e42-4449-9d84-434889f85b90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083592 Oct 02 01:26:35.826505 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 989/1971] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:35 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:36.848693 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:36.849305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:36.856330 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:36.856812 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:36.857245 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:36.857933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:36.858410 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:36.859101 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:36.918701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:36.926870 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-92457d78-59d5-455e-8cf2-d0b868ce0bb0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082016 Oct 02 01:26:36.927432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 983/1972] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:36 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:37.949424 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:37.949966 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:37.956429 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:37.956912 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:37.957350 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:37.958046 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:37.958524 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:37.958950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:38.018441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:38.026640 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24093be0-309a-4a67-979a-4bac75a8f7d7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081221 Oct 02 01:26:38.027214 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 990/1973] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:37 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:39.048695 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:39.049311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:39.055710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.056187 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.057116 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.057805 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:39.058284 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:39.058710 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:39.061240 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=84 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:39.120450 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:39.128505 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9589ae52-51f3-44d4-a9df-ac146a69bb7a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083670 Oct 02 01:26:39.129057 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 984/1974] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:39 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:40.152106 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:40.152817 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:40.159249 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:40.159722 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:40.160148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:40.160827 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:40.161272 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:40.161690 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:40.164202 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=84 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:40.224973 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:40.233264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98a6c5bb-f2ed-41b2-aa8c-03cef351d322 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085622 Oct 02 01:26:40.234146 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 991/1975] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:40 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:41.256736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:41.257174 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:41.264186 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.264777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.265217 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.265918 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:41.266406 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:41.266833 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:41.327169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:41.335508 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-14c428fe-acdb-4432-94dd-cd7560134d2c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082916 Oct 02 01:26:41.336417 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 985/1976] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:41 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:42.357825 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:42.358372 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:42.364570 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:42.365045 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:42.365475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:42.366187 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:42.366635 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:42.367059 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:42.426763 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:42.434893 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8296adfe-6196-4e3e-ad98-ae5563afe39e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081131 Oct 02 01:26:42.435449 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 992/1977] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:42 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:43.457018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:43.457562 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:43.464333 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:43.464815 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:43.465250 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:43.465942 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:43.466442 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:43.466872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:43.526224 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:43.534289 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-eb48d46f-4eff-42ee-9d56-c1264f910339 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081149 Oct 02 01:26:43.534858 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 986/1978] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:43 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:44.557830 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:44.558419 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:44.564950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:44.565422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:44.565846 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:44.566555 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:44.567002 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:44.567420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:44.632841 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:44.641112 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f3565d1-431c-4ce0-83c0-2d8e7fd65a03 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.087781 Oct 02 01:26:44.641680 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 993/1979] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:44 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:45.663198 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:45.663807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:45.670199 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:45.670675 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:45.671104 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:45.671781 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:45.672232 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:45.672650 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:45.731274 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:45.739597 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b667e21a-96d9-48c1-bcbd-7ee822dbefe8 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080211 Oct 02 01:26:45.740159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 987/1980] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:45 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:46.762457 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:46.763079 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:46.769524 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:46.770007 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:46.770476 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:46.771171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:46.771624 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:46.772056 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:46.832516 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:46.841205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-542fefc3-5c2c-4e5d-97b8-0afe9d4a6d20 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082721 Oct 02 01:26:46.841774 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 994/1981] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:46 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:47.864009 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:47.864558 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:47.870976 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.871455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.871891 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.872583 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:47.873043 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:47.873468 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:47.933988 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:47.942144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c252d66a-5730-4c21-abd0-275b26cfe35a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082055 Oct 02 01:26:47.942713 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 988/1982] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:47 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:48.965205 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:48.965822 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:48.972286 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:48.972755 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:48.973184 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:48.973862 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:48.974333 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:48.974748 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:49.037382 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:49.046321 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6d7147c7-e4b4-46fa-81f0-422649eca428 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085415 Oct 02 01:26:49.046885 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 995/1983] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:48 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:50.068785 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:50.069399 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:50.075985 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:50.076456 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:50.076886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:50.077565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:50.078013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:50.078461 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:50.137532 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:50.145595 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-8d65e5c4-c0e0-46da-8868-85424f389ed1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080692 Oct 02 01:26:50.146178 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 989/1984] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:50 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:51.167887 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:51.168501 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:51.174991 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:51.175472 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:51.175909 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:51.176596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:51.177048 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:51.177471 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:51.238950 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:51.247540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-217e2885-4a40-47d1-a6c2-80b67e4589e0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083515 Oct 02 01:26:51.248104 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 996/1985] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:51 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:52.271078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:52.271688 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:52.273979 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=28 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:52.279880 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:52.280356 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:52.280786 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:52.281469 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:52.281915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:52.282359 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:52.341807 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:52.349837 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-cf5ba1b9-65de-4a9c-b5af-1ca9fe510e37 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082566 Oct 02 01:26:52.350449 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 990/1986] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:52 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:53.372705 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:53.373255 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:53.375584 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=28 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:26:53.380834 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:53.381315 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:53.381757 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:53.382474 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:53.382929 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:53.383356 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:53.445694 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:53.453898 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1824744-7c4a-4845-bc45-99611bd66a90 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085188 Oct 02 01:26:53.454507 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 997/1987] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:53 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:54.476701 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:54.477331 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:54.484564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.485066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.485499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.486212 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:54.486661 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:54.487080 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:54.545635 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:54.553654 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c1eec2e2-0a73-49e1-b9dc-b6358bc3b8f4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080764 Oct 02 01:26:54.554237 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 991/1988] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:54 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 02 01:26:55.577226 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:55.577831 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:55.584315 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.584786 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.585232 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.585894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:55.586361 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:55.586783 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:55.647490 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:55.655582 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fadb80ce-88d7-4993-9611-9c38604e1a57 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082241 Oct 02 01:26:55.656136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 998/1989] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:55 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:56.677956 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:56.678629 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:56.685031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.685513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.685958 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.686678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:56.687135 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:56.687564 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:56.747037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:56.755046 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-db369f6c-d6d0-4a6c-8767-5092e6596ccd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080951 Oct 02 01:26:56.755616 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 992/1990] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:56 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:57.778368 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:57.779003 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:57.785606 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:57.786115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:57.786557 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:57.787256 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:57.787714 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:57.788168 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:57.849731 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:57.858854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a8c7a21-b5ef-4409-abc6-f56eac1fb4b4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084751 Oct 02 01:26:57.859415 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 999/1991] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:57 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:58.880718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:58.881311 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:58.887777 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:58.888260 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:58.888691 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:58.889377 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:58.889827 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:58.890285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:58.949310 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:26:58.957361 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7032dbbe-643f-43c6-a38f-1b10f106de3b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080514 Oct 02 01:26:58.957922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 993/1992] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:58 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:26:59.980020 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:26:59.980577 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:26:59.987270 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:59.987741 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:59.988171 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:26:59.988854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:26:59.989300 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:26:59.989716 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:00.049688 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:00.058343 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb4dcd44-f6d6-492b-872d-7332f1675b54 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082235 Oct 02 01:27:00.058913 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1000/1993] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:26:59 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:01.145297 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:01.145911 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:01.153131 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.153606 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.154037 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:01.154747 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:01.155192 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:01.155612 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:01.371872 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:01.380000 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-2924b7bf-f011-4f53-9838-db6047fc4a27 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.303108 Oct 02 01:27:01.380552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 994/1994] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:01 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:02.403169 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:02.403796 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:02.410181 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:02.410652 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:02.411082 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:02.411761 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:02.412206 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:02.412625 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:02.474275 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:02.483130 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a20a5594-f991-4bb4-a240-39c42d996436 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084469 Oct 02 01:27:02.483957 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1001/1995] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:02 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:03.506146 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:03.506759 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:03.513576 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.514051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.514511 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:03.515291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:03.515739 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:03.516158 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:03.575031 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:03.583118 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-df1778e9-4550-45f9-87b0-72f02e68f013 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080861 Oct 02 01:27:03.583664 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 995/1996] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:03 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:04.606025 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:04.606667 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:04.613738 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:04.614264 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:04.614708 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:04.615426 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:04.615921 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:04.616406 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:04.676897 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:04.685219 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9494381-e267-42d7-a1c6-7748a7ee51cd tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083799 Oct 02 01:27:04.685785 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1002/1997] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:04 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:05.707614 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:05.708234 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:05.714716 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:05.715194 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:05.715636 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:05.716302 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:05.716750 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:05.717169 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:05.776190 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:05.784130 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-92887c3f-3074-4345-891c-4bb56bbf3eae tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080360 Oct 02 01:27:05.784682 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 996/1998] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:05 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:06.806753 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:06.807358 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:06.813804 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:06.814314 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:06.814739 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:06.815416 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:06.815861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:06.816281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:06.878643 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:06.887287 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f748f63-861f-4c57-b016-ff739bc51ff9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.084977 Oct 02 01:27:06.887861 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1003/1999] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:06 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:07.909764 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:07.910335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:07.916700 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:07.917151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:07.917579 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:07.918291 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:07.918736 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:07.919151 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:07.978305 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:07.986813 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-d9f80f2f-50d9-4397-b262-f42d3820a37d tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081040 Oct 02 01:27:07.987385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 997/2000] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:07 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:09.009094 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:09.009706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:09.016115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:09.016588 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:09.017016 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:09.017696 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:09.018165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:09.018587 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:09.078459 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:09.086442 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26bdf78d-b925-4ce7-818d-40ad03de1fe7 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081206 Oct 02 01:27:09.087496 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1004/2001] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:09 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:10.109458 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:10.110080 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:10.116418 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:10.116895 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:10.117326 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:10.118694 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:10.119144 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:10.119565 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:10.123386 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=84 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:10.178322 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:10.187013 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e5f1ba0e-13fc-4ec9-a45f-970e6940a803 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081665 Oct 02 01:27:10.187569 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 998/2002] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:10 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:11.209216 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:11.209922 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:11.216613 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:11.217100 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:11.217540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:11.218269 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:11.218727 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:11.219158 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:11.223407 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=84 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:11.287009 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:11.295347 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1e93156-2133-4a71-8c82-184eccb853d6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.089994 Oct 02 01:27:11.295899 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1005/2003] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:11 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:12.318511 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:12.319078 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:12.325969 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:12.326490 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:12.326933 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:12.327630 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:12.328086 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:12.328513 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:12.388552 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:12.396600 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-590f2867-54fb-4164-bfd3-84cb451cb3ee tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082019 Oct 02 01:27:12.397154 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 999/2004] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:12 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:13.420468 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:13.421019 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:13.427066 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:13.427549 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:13.427989 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:13.428695 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:13.429136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:13.429559 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:13.489882 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:13.497937 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b8ddca9-6983-4be5-ad6e-c3e0fdfc701a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081594 Oct 02 01:27:13.498537 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1006/2005] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:13 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:14.519922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:14.520544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:14.526474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:14.526954 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:14.527388 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:14.528075 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:14.528530 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:14.528966 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:14.589863 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:14.597892 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-79ad5019-90cd-42a8-954a-136fb95d1ec9 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082011 Oct 02 01:27:14.598474 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1000/2006] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:14 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:15.620879 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:15.621491 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:15.627907 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.628381 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.628815 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:15.629500 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:15.629954 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:15.630413 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:15.693618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:15.702397 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b00a9e81-ef68-47ed-87f7-a4742c91581b tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085333 Oct 02 01:27:15.702962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1007/2007] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:15 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:16.724886 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:16.725499 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:16.732602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:16.733352 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:16.733788 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:16.734517 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:16.734967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:16.735393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:16.794432 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:16.802459 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-51903074-f75a-4ad2-8b1c-500e6f65ebce tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081520 Oct 02 01:27:16.803018 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1001/2008] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:16 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:17.824931 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:17.825475 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:17.831963 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:17.832441 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:17.832869 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:17.833546 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:17.833993 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:17.834437 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:17.894781 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:17.903236 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9040d358-3b31-4148-9f42-a36b42cb05a1 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082134 Oct 02 01:27:17.903947 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1008/2009] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:17 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:18.926455 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:18.927066 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:18.933903 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:18.934408 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:18.934839 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:18.935523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:18.935972 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:18.936394 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:18.995385 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:19.003448 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-e613eb57-958e-477c-8349-e140cdd705f6 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080871 Oct 02 01:27:19.004001 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1002/2010] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:18 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:20.027047 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:20.027669 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:20.034125 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:20.034608 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:20.035482 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:20.035719 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:20.036165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:20.036583 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:20.099996 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:20.108420 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c1959ea-a84c-4e0e-aa87-19622fd52b75 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085562 Oct 02 01:27:20.108977 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1009/2011] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:20 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:21.130862 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:21.131544 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:21.138645 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:21.139378 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:21.139854 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:21.140851 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:21.141412 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:21.141921 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:21.201626 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:21.209745 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-9c724f2d-c98b-4020-ba3a-1ea0f1e356f2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082861 Oct 02 01:27:21.210335 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1003/2012] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:21 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:22.232312 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:22.233157 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:22.239571 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:22.240044 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:22.240469 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:22.241150 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:22.241597 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:22.242013 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:22.302138 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:22.310962 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a98c4e2-c745-47fc-808b-91c33ea47690 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.082507 Oct 02 01:27:22.311529 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1010/2013] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:22 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:23.332285 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:23.332825 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:23.335428 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=28 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:23.341320 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:23.341798 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:23.342329 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:23.343025 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:23.343477 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:23.343901 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:23.411792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:23.419939 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-6471d6f5-3004-421f-b8e3-02812adc126c tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.091599 Oct 02 01:27:23.420497 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1004/2014] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:23 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:24.442633 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:24.443246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:24.445596 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=28 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:27:24.451595 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:24.452129 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:24.452563 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:24.453248 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:24.453699 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:24.454148 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:24.516485 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:24.524568 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5957b0d3-dc46-4de4-9af9-0ceb71a1fc16 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.085797 Oct 02 01:27:24.525800 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1011/2015] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:24 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:25.547644 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:25.548262 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:25.554674 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:25.555150 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:25.555584 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:25.556270 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:25.556721 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:25.557140 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:25.617051 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:25.625261 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-111fbe95-9b11-4a03-a9c7-b4003172ca9e tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081488 Oct 02 01:27:25.625824 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1005/2016] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:25 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:26.647540 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:26.648163 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:26.654632 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:26.655115 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:26.655551 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:26.656246 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:26.656706 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:26.657136 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:26.716422 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:26.724452 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8ae5640f-c420-4f2f-9b3c-83182d855dd0 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.080801 Oct 02 01:27:26.725023 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1012/2017] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:26 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:27.748227 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:27.748844 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:27.755314 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:27.755792 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:27.756224 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:27.756914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:27.757357 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:27.757776 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:27.817044 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:27.825930 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-c207d59c-35a2-4f20-8b9a-4824111a8b89 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081559 Oct 02 01:27:27.826454 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1006/2018] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:27 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:28.848091 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:28.848697 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:28.855143 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:28.855618 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:28.856050 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:28.856728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:28.857172 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:28.857589 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:28.920142 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:28.928173 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ef4573f-6a33-45fa-b80e-257a6d1b4e99 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083930 Oct 02 01:27:28.928728 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1013/2019] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:28 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:29.950676 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:29.951218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:29.957651 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:29.958159 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:29.958602 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:29.959300 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:29.959754 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:29.960180 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:30.019991 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:30.028646 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-4ec40aeb-b282-44d6-aa45-51b2ca38c6e4 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081878 Oct 02 01:27:30.029218 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1007/2020] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:29 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:31.051894 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:31.052530 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:31.059384 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:31.059853 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:31.060281 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:31.060960 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:31.061404 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:31.061854 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:31.121034 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.policy [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:31.129017 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e23de31b-249f-470a-aab8-04e5abf51917 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.081053 Oct 02 01:27:31.129573 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1014/2021] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:31 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:32.151915 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:32.152531 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.compute.api [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] [instance: bcf3492e-1bdf-44e5-a0dc-e15824c17792] Fetching instance by UUID {{(pid=120424) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 02 01:27:32.158914 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:32.159393 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:32.159830 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:32.160523 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Acquiring lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 02 01:27:32.160978 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 02 01:27:32.161405 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG oslo_concurrency.lockutils [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Lock "c3c3637e-55d8-46cc-8af5-7f3f543268bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120424) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 02 01:27:32.222678 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.policy [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e0ae04969b4f7684cb21edaaa85b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4a21c5f4b04110b2fa42a2bba32348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120424) authorize /opt/stack/nova/nova/policy.py:199}} Oct 02 01:27:32.230728 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-b759b565-1588-4661-bbcf-76ff72d83a5a tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792" status: 200 len: 1388 microversion: 2.1 time: 0.083259 Oct 02 01:27:32.231287 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1008/2022] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Oct 2 01:27:32 2022] GET /compute/v2.1/servers/bcf3492e-1bdf-44e5-a0dc-e15824c17792 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 02 01:27:32.252790 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc8c4d7b-0e0b-4dac-ae86-4a29805248e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] Calling method '.version_select at 0x7f6e78e57550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:27:32.275614 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc8c4d7b-0e0b-4dac-ae86-4a29805248e2 tempest-TestMinimumBasicScenario-818184896 tempest-TestMinimumBasicScenario-818184896-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-662543878" status: 202 len: 0 microversion: 2.1 time: 0.026528 Oct 02 01:27:32.276165 dv-cinder-master-3-iscsi devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1015/2023] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Oct 2 01:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-662543878 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 02 01:31:42.526402 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf55bc6a-1cc6-42a9-b65b-b1c4dd695e6c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 02 01:31:42.526952 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_api:SELECT=9 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:42.527718 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG dbcounter [-] [120424] Writing DB stats nova_cell1:SELECT=65 {{(pid=120424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 02 01:31:42.528481 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 02 01:31:42.528621 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1356466823 (ip 10.222.0.25) !!! Oct 02 01:31:42.529803 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 01:31:42.529923 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1356466823 (ip 10.222.0.25) !!! Oct 02 01:31:42.530967 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 02 01:31:42.531084 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: Sun Oct 2 01:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1356466823 (ip 10.222.0.25) !!! Oct 02 01:31:42.535127 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: DEBUG nova.api.openstack.wsgi [None req-7f5ac04b-6288-47d0-a040-fc4a2ec54ae9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] Calling method '.version_select at 0x7f6e79040790>' {{(pid=120424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 02 01:31:42.565922 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: INFO nova.api.openstack.requestlog [None req-7f5ac04b-6288-47d0-a040-fc4a2ec54ae9 tempest-TestVolumeBootPattern-747325683 tempest-TestVolumeBootPattern-747325683-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1356466823" status: 202 len: 0 microversion: 2.1 time: 0.041563 Oct 02 01:31:42.566540 dv-cinder-master-3-iscsi devstack@n-api.service[120424]: [pid: 120424|app: 0|req: 1009/2024] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Oct 2 01:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1356466823 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)